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(54) Title: SPECTRAL BIO-IMAGING OF THE EYE 
(57) Abstract 



A spectral bio-imaging method 
for enhancing pathologic, physiologic, 
metabolic and health related spectral 
signatures of an eye tissue, the method 
comprising the steps of: (a) providing 
an optical device for eye inspection 
being optically connected to a spectral 
imager, (b) illuminating the eye tissue 
with light via the iris, viewing the eye 
tissue through the optical device and 
spectral imager and obtaining a spectrum 
of light for each pixel of the eye tissue; 
and (c) attributing each of the pixels 
color or intensity according to its 
spectral signature, thereby providing an 
image enhancing the spectral signatures 
of the eye tissue. 
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SPECTRAL BIO-IMAGING OF THE EYE 

FIELD AND BACKGROUND OF THE INVENTION 

The present invention relates to spectral imaging in general and, more 

5 particularly, to spectral bio-imaging of the eye which can be used for non-invasive 
early detection and diagnosis of eye diseases and for detection of spatial 
organization, distribution and quantification of cellular and tissue natural 
constituents, structures and organelles, tissue vitality, tissue metabolism, tissue 
viability, etc., using light reflection, scattering and emission, with high spatial and 

10 spectral resolutions. 

A spectrometer is an apparatus designed to accept light, to separate 
(disperse) it into its component wavelengths and measure a spectrum, that is the 
intensity of the light as a function of its wavelength. An imaging spectrometer 
(also referred to hereinbelow as a spectral imager) is one which collects incident 

15 light from a scene and measures the spectra (in part or in full)of each pixel or 
picture element thereof. 

Spectroscopy is a well known analytical tool which has been used for 
decades in science and industry to characterize materials and processes based on 
the spectral signature of chemical constituents. The physical basis of spectroscopy 

20 is the interaction of light with matter. Traditionally, spectroscopy is the 
measurement of the light intensity emitted, transmitted, scattered or reflected from 
a sample, as a function of wavelength, at high spectral resolution, but without any 
spatial information. 

Spectral imaging, on the other hand, is a combination of high resolution 

25 spectroscopy and high resolution imaging (i.e., spatial information). The closest 
work so far described with respect to the eye concerns either obtaining high spatial 
resolution information, yet providing only limited spectral information, for 
example, when high spatial resolution imaging is performed with one or several 
discrete band-pass filters [see, for example, Patrick J. Saine and Marshall E. Tyler, 
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Ophthalmic Photography, A textbook of retinal photography, angiography, and 
electronic imaging, Butterwoith-Heinemann, Copyright 1997, ISBN 0-7506-9793- 
8, p. 72], or alternatively, obtaining high spectral resolution (e.g., a full spectrum), 
yet limited in spatial resolution to a small number of points of the eye or averaged 
5 over the whole sample [See for example, Delori F. C, Pfilbsen K. P., Spectral 
reflectance of the himian ocular fundus. Applied Optics Vol. 28, pp. 1061-1077, 
1989]. 

Conceptually, a spectral imaging system consists of (i) a measurement 
system, and (ii) an analysis software. The measurement system includes all of the 

10 optics, electronics, illumination source, etc., as well as calibration means best 
suited for extracting the desired results from the measurement. The analysis 
software includes all of the software and mathematical algorithms necessary to 
analyze and display important results in a meaningfiil way. 

Spectral imaging has been used for decades in the area of remote sensing to 

15 provide important insights in the study of Earth and other planets by identifying 
characteristic spectral absorption features. However, the high cost, size and 
configuration of remote sensing spectral imaging systems (e.g., Landsat, AVIRIS) 
has limited their use to air and satellite-bom applications [See, Maymon and 
Neeck (1988) Proceedings of SPIE - Recent Advances in Sensors, Radiometry and 

20 Data Processing for Remote Sensing, 924, pp. 10-22; Dozier (1988) Proceedmgs 
of SPIE - Recent Advances in Sensors, Radiometry and Data Processing for 
Remote Sensing, 924, pp. 23-30] 

There are three basic types of spectral dispersion methods that might be 
considered for a spectral bio-imaging system: (i) spectral grating and/or prism, (ii) 

25 spectral filters and (iii) interferometric spectroscopy. 

In a grating/prism (i.e., monochromator) based systems, also known as 
slit-type imaging spectrometers, such as for example the DILOR system: [see, 
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Valisa et al. (Sep. 1995) presentation at the SPBE Conference European Medical 
Optics Week, BiOS Europe '95, Barcelona, Spain], only one axis of a CCD (charge 
coupled device) array detector (the spatial axis) provides real imagery data, while a 
second (spectral) axis is used for sampling the intensity of the light which is 

5 dispersed by the grating as function of wavelength. The system also has a slit in a 
first focal plane, limiting the field of view at any given time to a line of pixels. 
Therefore, a full image can only be obtained after scanning the grating or the 
incoming beam in a direction parallel to the spectral axis of the CCD in a method 
known in the literature as line scanning. The inability to visualize the two- 

10 dimensional image before the whole measurement is completed makes it 
impossible to choose, prior to making a measurement, a desired region of interest 
from within the field of view and/or to optimize the system focus, exposure time, 
etc. Grating based spectral imagers are popular in use for remote sensing 
applications, because an airplane (or satellite) flying over the surface of the Earth 

IS provides the system with a natural line scaiming mechanism. 

It should be further noted that slit-type imaging spectrometers have a major 
disadvantage since most of the pixels of one frame are not measured at any given 
time, even though the fore- optics of the instrument actually collects incident light 
from all of them simultaneously. The resuh is that either a relatively large 

20 measurement time is required to obtain the necessary information with a given 
signal-to-noise ratio, or the signal-to-noise ratio (sensitivity) is substantially 
reduced for a given measurement time. Furthermore, slit-type spectral imagers 
require line scanning to collect the necessary information for the whole scene, 
which may introduce inaccuracies to the results thus obtained. 

25 Filter based spectral dispersion methods can be further categorized into 

discrete filters and tunable filters. In these types of imaging spectrometers the 
spectral image is built by filtering the radiation for all the pixels of the scene 
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simultaneously at a different wavelength at a time by inserting in succession 
nanow band filters in the optical pafli, or by electronically scanning the bands 
using AOTF or LCTF (see below). 

Similarly to the slit type imaging spectrometers equipped with a grating, as 
described above, while using filter based spectral dispersion methods, most of the 
radiation is rejected at any given time. In feet, the measuremmt of the whole 
image at a specific wavelength is possible because all the photons outside the 
instantaneous wavelength measured are rejected and do not reach the CCD. 

Tunable filters, such as acousto-optic tunable filters (AOTFs) and liquid- 
crystal tunable filter (LCTFs) have no moving parts and can be tuned to any 
particular wavelength in the spectral range of the device in which they are 
implemraited. One advantage of using tunable filters as a dispersion method for 
spectral imaging is their random wavelength access; i.e., the ability to measure the 
intensity of an image at a number of wavelengths, in any desired sequence without 
the use of a mechanical filter wheel. However, AOTFs and LCTFs have the 
disadvantages of (i) limited spectral range (typically, A-max ^hoia) while all 
other radiation that falls outside of this spectral range must be blocked, (ii) 
temperature sensitivity, (iii) poor transmission, (iv) polarization sensitivity, and (v) 
in the case of AOTFs an effect of shifting the image during wavelength scanning. 

All these types of filter and tunable filter based systems have not been used 
successfiilly and extensively over the years in spectral imaging for any application, 
because of their limitations in spectral resolution, low sensitivity, and lack of easy- 
to-use and sophisticated software algorithms for interpretation and display of the 
data. 

No literature has been fo\md by the inventors of the present invention 
describing high resolution spectroscopy combined with high resolution imaging 
applied to the eye. 
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A method and apparatus for spectral analysis of images which have 
advantages in the above respects were disclosed in U.S. Pat. Nos. 5,539,517 and 
5,835,214 to Cabib et aL, which are incorporated by reference as if fiilly set forth 
herein, with the objective to provide methods and apparatuses for spectral analysis 

s of images which better utilizes all the information available from the collected 
incident light of the unage to substantially decrease the required frame time and/or 
to substantially increase the signal-to-noise ratio, as compared to the conventional 
slit- or filter type imaging spectrometers and do not involve line scanning. 

According to this invention, there is provided a method of analyzing an 

10 optical image of a scene to deteraiinc the spectral intensity of each pixel thereof by 
collecting incident light from the scene; passing the light through an mterferometer 
which outputs modulated light corresponding to a predetermined set of linear 
combinations of the spectral intensity of the light emitted from each pixel; 
focusing the light outputted from the interferometer on a detector array, scanning 

15 the optical path difference (OPD) generated in the interferometer for all pixels 
independently and simultaneously and processing the outputs of the detector array 
(the interferograms of all pixels separately) to determine the spectral intensity of 
each pixel thereof. 

This method may be practiced by utilizing various types of interferometers 
20 wherein the OPD is varied to build the interferograms by movmg the entire 
interferometer, an element within the interferometer, or the angle of incidence of 
the incoming radiation. In all of these cases, when the scanner completes one scan 

Apparatuses in accordance with the above features differ from the 
25 conventional slit- and filter type imaging spectrometers by utilizing an 
interferometer as described above, therefore not Ihniting the collected energy with 
an aperture or slit or limiting the incoming wavelength with narrow band 
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interference or tunable filters, thereby substantially increasing the total throughput 
of the system. 

Thus, interferometer based {q)paFatuses better utilize all tiie information 
available from the incident light of the scene to be analyzed, thereby substantially 
5 decreasing the measuring time and/or substantially increasing the signal-to-noise 
ratio (i.e., sensitivity). 

Consider, for example, the "whisk broom" design described in John B. 
Wellman (1987) Imaging Spectrometers for Terrestrial and Planetary Remote 
Sensing, SPIE Proceedings, Vol. 750, p. 140. Let n be the number of detectors in 
10 the linear array, mxmthc number of pixels in a frame and Fthe frame time. The 
total time spent on each pixel in one frame summed over all the detectors of the 
array is nT/m^. By using the same size array and the same frame rate in a method 
according to the invention described in U.S. Pat. No. 5,539,517, the total time 
spent summed over all the detectors on a particular pixel is the same, nT/m^ . 
15 However, whereas in the conventional grating method the energy seen by 

every detector at any given time is of the order of 1/n of the total, because the 
wavelength resolution is l/n of the range, in a method according to the invention 
described in U.S. Pat. No. 5,539,517 the energy is of the order of unity because the 
modulating fimction is an oscillating function (e.g., sinusoidal (Michelson) or a 
20 similar periodic function, such as the low finesse Airy function with Fabry-Perot) 
whose average over a large OPD range is 50 %. Based on the standard treatment 
of the Fellgett advantage (or multiplex advantage) described in interferometry 
textbooks [for example, see, Chamberlain (1979) The principles of interferometric 
spectroscopy, John Wiley and Sons, pp. 16-18 and p. 263], it is possible to show 
25 that devices according to this invention have measurement signal-to-noise ratios 
which are improved by a factor of n^-^ in the cases of noise limitations in which 
the noise level is independent of signal (system or background noise limited 
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situations) and by the square root of the ratio of the signal at a particular 
wavelength to the average signal in the spectral range, at wavelengths of a narrow 
peak in the cases the limitation is due to signal photon noise. 

Thus, according to the invention described in U.S. Pat No. 5,539,517. all 

5 the required OPDs are scanned simultaneously for all the pixels of the scene in 
order to obtain all the information required to reconstruct the spectrum, so that the 
mation is collected simultaneously with the imaging information. 
Spectral bio-hnaging systems are potentially useful in all applications in 
which subtle spectral differences exist between chemical constituents whose 

10 spatial distribution and organization within an image are of interest. The 
measurement can be carried out using virtually any optical system attached to the 
system described in U.S. Pat. No. 5,539,517, for example, an upright or inverted 
microscope, a fluorescence microscope, a macro lens, an endoscope or a fundus 
camera. Furthermore, any standard experimental method can be used, including 

15 light transmission (bright field and dark field), autofluorescence and fluorescence 
of administered probes, light transmission, scattering and reflection. 

Fluorescence measurements can be made with any standard filter cube 
(consisting of a barrier filter, excitation filter and a dichroic mirror), or any 
customized filter cube for special applications, provided that the emission spectra 

20 fall within the spectral range of the system sensitivity. 

Spectral bio-imaging can also be used in conjunction with any standard 
spatial filtering method such as dark field and phase contrast, and even with 
polarized light microscopy. The effects on spectral information when using such 
methods must, of course, be understood to correctly interpret the measured spectral 

25 images. 

Reflection of visible light from the ocular fundus has been used for many 
years for research and for routme eye inspection by ophthalmologists. It is also the 
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basis for recording the eye status of a patient for disease and treatment follow up, 
both as pictures on a camera film and as digital images in the computer memory. 

In contrast, the spectral dependence of the light reflection from differmt 
regions of the fundus has been relegated only to research work. The reasons for 
5 these facts are (i) images are a veiy direct means of presenting information to a 
human being, because they are easily interpreted, compared and remembered by 
the human brain; (ii) spectral data are much less direct, are not inunediately 
understandable, and to be useful they must usually undergo several layers of 
mathematical processing before they are related to the bio-physiological properties 
10 of the tissue in question; and (iii) there has been so far no affordable 
instrumentation available to collect and analyze spectral data from the fundus, 
which is easy to use, fast, and reliable for a research or clinical setting. 

As a result, at present, the use of spectral information in many fields, and m 
particular in ophthahnology, is lagging enormously behind the imaging techniques. 
15 Recently, Applied Spectral Imaging Ltd. of Migdal Haemek, Israel, has 

developed the SPECTRACUBE technology. The SPECTRACUBE technology is 
based on an interferometer based spectral imager and as such it combines 
spectroscopy and imagmg to use the advantages of both. It collects spectral data 
from all the pixels of an image simultaneously so that, after appropriate processing, 
20 the important chemical composition of the studied object (related to its bio- 
physiological properties) can be mapped and visualized. 

The SPECTRACUBE technology was employed for spectral (color) 
karyotyping which simplifies and improves the detection capability of 
chromosomal aberrations using fluorescence emission [see. Multicolor spectral 
25 karyotyping of human chromosomes. E. Schroeck et al.^ Science, 273, 494-497, 
1996; Multicolor spectral karyotyping of mouse chromosomes. Marek Liyanage 
etal Nature Genetics p. 312-315, 1996; Spectral Karyotyping, Yuval Garini, et 
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al. Bioimaging 4, p. 65-72, 1996; Hidden chromosome abnomialities in 
haemotoiogical malignancies detected by multicolor spectral Karyotyping. Tim 
Veldman, Christine Vignon, Evelin Schrock, Janet D. Rowley & Thomas Ried. 
Nature Genetics, April, 1997: 406-410.; Spectral Karyotyping: Chromosomes in 

5 Color. Turid Knutsen, Tim Veldman, Hesed Padilla-Nash, Evelin Schrock, Morek 
Liyanage, Thomas Ried. Applied Cytogenetics, 23(2) 1997, pp. 26-32.; and Early 
Experiences with SKY: A Primer for the Practicing Cytogenetic Technologist. 
Michele Shuster, Ulrike Bockmuhl, Susaime M. GoUin. Applied Cytogenetics, 
23(2) 1997, pp. 33-37]. 

10 Diabetic retinopathy is a potentially devastating condition of the human 

vision system, that, in most cases, can be controlled with timely laser treatment 
[Ferris (1993) (conmientary) JAMA 269:1290-1291], The American Academy of 
Ophthalmology has suggested screening schedules to detect when patients develop 
clinical conditions which should be treated [Diabetic Retinopathy: American 

15 Academy of Ophthahnology Preferred Practice Patterns. San Francisco, Cal.: 
American Academy of Ophthalmology Quality of Care Conmiittee Retinal Pane, 
American Academy of Ophthahnology, 1989]. 

However the suggested screening schedule is expensive, and for some 
individuals even the current expensive screening is not sufficient because patients 

20 occasionally develop severe retinopathy between scheduled examinations. In spite 
of this, it has been shown that this screening is cost effective [Javitt et al. (1989) 
Ophthalmology 96:2SSr64]. This work shows that a large amount of money could 
be saved in health care follow up, if high and low risk patients could be more 
effectively identified. Therefore, any method that could increase the accuracy and 

25 reduce the cost of screening for diabetic retinopathy would be of high clinical 
value. 
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Curraitfy, the recommended screening evaluation for diabetic retinopathy 
includes a detailed retinal evaluation and, in selected cases, color retinal 
photography [Diabetic Retinopathy: American Academy of Ophthalmology 
Preferred Practice Patterns. San Francisco, Cal.: American Academy of 
5 Ophthalmology Quality of Care Committee Retinal Pane, American Academy of 
Ophthahnology. 1989]. Fluorescein angiography of the retina is routinely 
performed today, but it is invasive, unpleasant, and causes occasional deaths. 
Furthermore, the additional information obtained by fluorescein angiography does 
not help categorize patients into those who may benefit from immediate laser 
10 treatment and those who will not [Ferris (1993) (commentary) JAMA 269:1290-1]. 

The oxygen supply of the retina is provided by both the choroidal and 
retinal circulation. The choroid serves as tiie oxygen source for the photoreceptors 
m the avascular outer retina, whereas the retinal circulation plays a crucial role in 
maintaining the oxygen supply to the neural elements and nerve fibers in the inner 
15 retina. Because of the high oxygen needs of the retina, any alteration in circulation 
such as seen in diabetic retinopathy, hypertension, sickle cell disease, and vascular 
occlusive diseases results in fimctional impairment and extensive retinal tissue. 

Noninvasive measurements of the oxygen saturation of blood in retinal 
vessels was first proposed by Hickham et al. [Hickham et al. (1963) Circulation 
20 27:375] using a two-wavelength photographic technique (560 and 640 nm) for 
retinal vessels crossing the optic disk (the region where the optic nerve connects to 
the retina). A more advanced approach based on the three wavelength method of 
Pittman and Duling is presented m Delori (1988) Applied Optics 27:1 113-1 125. 

The present invention is the first step towards showing the usefulness of 
25 spectral imaging in general and the SPECTRACUBE technology in particular, as a 
new tool for the analysis of the physiological state of various structures of the 
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human ocular fundus and enhance the accuracy of diagnosis and prognosis of 
certain diseases which affect the eye. 

The ability to collect data of physiological importance in a spatially 
organized way» to store them for later retrieval and to display them in an enhanced 

5 image mode for easy interpretation provides a new horizon in ophthaknology. 

In recent years, optical imaging methods and instrumentation for analyzing 
the ocular fundus have been making important progress. In particular, the 
integration of the optical techniques with sophisticated image processing by 
computer, are becoming more and more popular, because they contribute to the 

10 visualization of the pathology in vivo and to the quantification of the structure and 
functions or dysfunction involved therewith. In addition, it improves comparisons 
across time and can prevent loss of information (see Practical Atlas of Retinal 
Disease and Therapy, edited by William R. Freeman, Raven press, New York, 
1993, p. 19). Besides digital imaging by CCD cameras in conjunction with a 

15 fundus camera, the modem instrumentation includes Scanning Laser 
Ophthalmoscope (SLO), Laser Tomographic Scanner (LTS) (see Practical Atlas of 
Retinal Disease and Therapy, edited by William R. Freeman, Raven press, New 
York, 1993, p. 19), Optic Nerve Analysis systems (Ophthalmic Photography, edited 
by Patrick J. Saine and Marshall E. Tyler, Butterworth-Heinemann, 1997, p. 269) 

20 and others, each of which employs a different and unique technology. 

Different imaging modes are also used, such as "Confocal Imaging" and 
"Indirect Imaging" modes, to highlight and emphasize different features of the 
ocular fundus (see Practical Atlas of Retinal Disease and Therapy, edited by 
William R. Freeman, Raven press. New York, 1993, pp. 20 and 21). 

25 It is also well known that imaging at specific wavelengths of visible light 

and the use of infirared light yields different types of mformation on the ocular 
fundus because different wavelengths are absorbed and scattered differently by the 
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various fundus layers, anatomic structures (retina, choroid, vessels, pigment 
epithelium, sclera, etc.) and Cerent depths (see Practical Atlas of Retinal Disease 
and Therapy, edited by William R. Freeman, Raven press. New York, 1993, p. 23, 
and Ophthalmic Photography, edited by Patrick J. Saine and Marshall E. Tyler, 
5 Butterworth-Heinemann, 1997, p. 71-73; see also U.S. Pat application No. 
08/942,122, which is incorporated by reference as if fully set forth herein). 

Fluorescein and Indocyanine Green An^ogr^hy are standard techniques 
used by the ophtfiabnologists for the analysis of vessels, blood flow, and related 
pathologies, and provide information critical to the diagnosis and treatment of eye 
10 diseases (Ophthalmic Photography, edited by Patrick J. Saine and Marshall E. 
Tyler, Butterworth-Heinemann, 1997, p. 261-263, and pp. 273-279 and Practical 
Atlas of Retinal Disease and Therapy, edited by William R. Freeman, Raven press. 
New York, 1993, pp. 25-29). Both of these tests use the intravenous injection of 
fluorescent dyes, which circulate in the blood, and allow the documentation of 
15 ocular vasculature and blood flow. Fluorescein Angiography (FA) is used for 
retinal vessels, while Indocyanine Green Angiography (ICG) has advantages for 
imaging the choroidal vessels, for example choroidal neovascularization 
(Ophthalmic Photography, edited by Patrick J. Saine and Marshall E. Tyler, 
Butterworth-Heinemann, 1997, p. 264, Fig. 7-34). Disadvantages of FA and 
20 ICG are that th^ require injection of a dye, which sometimes is dangerous, for 
example there is a requirement for screening patients for iodine allergy, and since 
the effect of the dye is dynamic, several images must be recorded between 2 and 
60 minutes after mjection. 

Blood is a worse absorbent of infrared light than of visible light, so it is also 
25 useful to image features which are in the posterior layers or behind vessels or thin 
hemorrhages (see Ophthahnic Photography, edited by Patrick J Saine and Marshall 
E Tyler, Butterworth-Heinemann, 1997, p. 263, and the study by Eisner A E er a/.. 
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Infrared imaging of sub-retinal structures in the human ocular fundus. Vision Res. 
1996 Jan; 36(1): 191-205.). 

In spite of what is known today on the wavelength dependence of fundus 
imaging of reflected white light, there is no conunercial instrumentation which is 

5 used for imaging of choroidal vasculature and other features at or near the 
choroidal depth, based on the reflection of white light. 

There is thus a widely recognized need for, and it would be highly 
advantageous to have methods of spectral bio-imaging of the eye which can be 
used for non-invasive early detection and diagnosis of eye associated diseases. 

10 In particular, there is a widely recognized need for, and it would be highly 

advantageous to have an instrumentation and method capable of high quality 
imaging of choroidal vessels and similar tissues at or near the depth of the choroid, 
using high throughput spectral imaging instrumentation of white light reflection, or 
reflection imaging of successive monochromatic light illumination. Among the 

15 results of high throughput are that the system can be built with a reasonably small 
size and can measure at reasonably high speed, so that it is more efficient and 
therefore suitable for sale in larger quantities and as a consequence, at lower cost. 
Another important advantage of the present invention over present methods of 
choroidal imaging is the avoidance of systemic dye injection and all related 

20 complications, for the clinic performing the test and for the patient receiving it. 

SUMMARY OF THE INVENTION 

According to the present invention there is provided a method for spectral 
imaging of an eye tissue, which can be used for non-invasive early detection and 
25 diagnosis of eye associated diseases and for detection of spatial organization, 
distribution and quantification of cellular and tissue natural constituents, structures 
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and organelles, tissue vitality, tissue metabolism, tissue viability, etc, using light 
reflection, scatt^ing and emission, with high spatial and spectral resolutions. 

According to further features in preferred embodiments of the invention 
described below, there is provided a spectral bio-imaging method for enhancing 
spectral signatures of an eye tissue, the method comprising the steps of (a) 
providing an optical device for eye inspection bemg optically connected to a 
spectral imager; (b) illuminating the eye tissue with light via the iris, viewing the 
eye tissue through the optical device and spectral imager and obtaining a spectrum 
(e.g., full or portions thereoO of light for each pixel of the eye tissue; and (c) 
attributing each of the pixels a color or intensity according to its spectral signature 
(e.g., full or portions thereof), e.g., in a predefined spectral range, thereby 
providing an image enhancing the spectral signatures of the eye tissue. The optical 
device can be integrally formed with the spectral imager. 

Accordmg to still further features in the described preferred embodiments 
there is provided a spectral bio-imaging method for extracting a spectral signature 
of a first portion of a layer of an object including at least two layers, each of the at 
least two layers has different spectral characteristics, the method comprising the 
steps of (a) providmg an optical device being optically connected to a spectral 
imager; (b) illuminatmg the object with light, viewing the object through the 
optical device and spectral imager and obtainmg a continuous spectrum of light for 
each pixel of the object; (c) using the continuous spectrum of light of each pixel of 
the object for generating a spectral image of the object in which the first portion is 
identifiable; (c) identifying in the spectral image the first portion of the layer and a 
second portion being adjacent to the first portion; and (d) accounting for spectral 
characteristics of the second layer, extracting the spectral signature of the first 
portion. 
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According to still further features in the described preferred embodiments 
the object is an ocular fundus, the at least two layers include a retinal layer and a 
choroidal layer and the first portion is selected jfrom the group consisting of a 
retinal blood vessel and a choroidal blood vessel. 
5 According to still further features in the described preferred embodiments 

the spectral signature is indicative of an oxygenation state of the first portion. 

According to still further features in the described preferred embodiments 
the method further comprising the step of marking a mark indicative of the 
oxygenation state of the first portion on the spectral image in context of the first 
10 portion. 

According to still further features in the described preferred embodiments 
the mark is a numerical value. 

According to still further features in the described preferred embodiments 
the step of extracting the spectral signature of the first portion includes averaging 

15 over a plurality of the pixels. 

According to still further features in the described preferred embodiments 
there is provided a method of evaluating a medical condition of a patient 
comprising the step of extracting a spectral signature of a retinal or choroidal 
blood vessel of a retina or choroid of an eye by (a) providmg an optical device 

20 being optically connected to a spectral imager; (b) illuminating the eye with light, 
viewmg the eye through the optical device and spectral imager and obtaining a 
continuous spectrum of light for each pixel of the eye; (c) using the continuous 
spectrum of light of each pixel of the eye for generating a spectral image of the eye 
in which the retinal or choroidal blood vessel is identifiable; (c) identifying in the 

25 spectral image the retinal or choroidal blood vessel and a tissue being adjacent to 
the retinal or choroidal blood vessel; (d) accounting for spectral characteristics of 
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the tissue, extracting the spectral signature of the retinal or choroidal blood vessel; 
and (e) using the spectral signature to evaluate the medical condition of the patient. 

According to still further features in the described preferred embodiments 
there is provided an apparatus for providing a display of an image presenting an 

5 eye tissue and a marking of an oxygenation state of at least one blood vessel 
therein, the apparatus comprising (a) an optical device for ^e inspection being 
optically connected to a spectral imager; (b) an illumination source for illuminating 
the eye tissue with light via the iris; and (c) an image display device for displaying 
the image; wherein the image is realized by viewing the eye tissue through the 

10 optical device and spectral imager and obtaining a spectrum of light for each pixel 
of the eye tissue; by attributing each of the pixels a color or intensity according to 
its spectral signature, thereby providing the image enhancing the spectral 
signatures of the eye tissue; and further by marking in context of the at least one 
blood vessel the oxygenation state thereof 

15 According to still further features in the described preferred embodiments 

the spectral imager is selected from the group consisting of a filters based spectral 
imager, a monochromator based spectral imager (including successively 
monochromatic illumination spectral imaging) and an interferometer based spectral 
imager. 

20 According to still further features in the described preferred embodiments 

the spectral imager is a high throughput spectral imager is selected from the group 
consisting of a wideband filters based spectral imager, decorrelation matched 
filters based spectral imager and an interferometer based specU^l imager. 

According to still further features in the described preferred embodiments 

25 step (b) includes (i) collecting incident light simultaneously from all pixels of the 
eye using collimating optics; (ii) passing the incident coUimated light through an 
interferometer system having a number of elements, so that the light is first split 
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into two coherent beams which travel in different directions inside the 
interferometer and then the two coherent beams recombine to interfere with each 
other to form an exiting light beam; (iii) passing the exiting light beam through a 
focusing optical system which focuses the exiting light beam on a detector having 

5 a two-dimensional array of detector elements; (iv) rotating or translating 
(scanning) -one or more of the elements of the interferometer system, so that an 
optical path difference between the two coherent beams generated by the 
interferometer system is scanned simultaneously for all the pixels; and (v) 
recording signals of each of the detector elements as function of time using a 

10 recording device to form a spectral cube of data. 

According to still further features in the described preferred embodiments 
the optical device is selected from the group consisting of a fundus camera and a 
funduscope. 

According to still further features in the described preferred embodiments 
15 the spectrum of light represents light selected from the group consisting of, light 
reflected from the eye tissue, light scattered from the eye tissue and light emitted 
from the eye tissue. 

According to still further features in the described preferred embodiments 
the light emitted from the eye tissue is selected from the group consisting of 
20 administered probe fluorescence, administered probe mduced fluorescence and 
auto-fluorescence. 

According to still further features in the described preferred embodiments 
the light used for illuminating the eye tissue is selected from the group consisting 
of coherent light, white light, filtered light, ultraviolet light, infrared light and a 
25 light havmg a small wavelength range. 

According to still further features in the described preferred embodiments 
the two-dimensional array is selected from the group consisting of a video rate 
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CCD, a cooled high dynamic range CCD, an intensified CCD and a time gated 
intensified CCD. 

According to still further features in the described preferred embodiments 
the eye tissue is selected firom the group consisting of eye retina, a retinal blood 
5 vessel an optic disk, an optic cup, eye macula, fovea, cornea, iris, lens, nerve fiber 
layer, choroid, choroidal layer, choroidal blood vessel, pigment epithelium and 
Bruch's membrane, of any combination thereof. 

According to still further features in the described preferred embodiments 
the eye tissue includes a blood vessel, the method is for detecting and mapping the 
10 oxygenation level of hemoglobin along the blood vessel. 

According to still further features in the described preferred embodiments 
step (c) is effected using a mathematical algorithm which computes a Red-Green- 
Blue color image using predefined wavelength ranges. 

According to still further features in the described preferred embodiments 
15 step (c) is effected using a mathematical algorithm which computes a gray scale 
image using predefined wavelength ranges. 

According to still further features in the described preferred embodiments 
the spectral signature and, as a result, the color is affected by a substance selected 
fi-om the group consisting of hemoglobin, cytochromes, oxidases, reductases, 
20 flavins, nicotinamide adenine dinucleotide, nicotinamide adenine dinucleotide 
phosphate, collagen, elastin, xanthophyll and melanin. 

According to still further features in the described preferred embodiments 
enhancing the spectral signatures of the eye tissue includes an enhancement 
selected from the group consisting of enhancing arteries, enhancing veins, 
25 enhancing hemoglobin concentration, enhancing hemoglobin oxygen saturation 
level and melanoma and hemangioma lesions. 
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According to still further features in the described preferred embodiments 
the method further comprising the step of correcting spatial and spectral 
infomiation for movements of the eye tissue via a spatial registration and spectral 
correction procedures. 

5 According to still further features in the described preferred embodiments 

there is provided a method of evaluating a medical condition of a patient 
comprising the step of enhancing spectral signatures of an eye tissue of the patient 
by (a) providing an optical device for eye inspection being optically connected to a 
spectral imager, e.g., a high throughput spectral imager; (b) illuminating the eye 

10 tissue of the patient with light via the iris, viewing the eye tissue through the 
optical device and spectral imager and obtaining a light spectrum for each pixel of 
the eye tissue; (c) attributing each of the pixels a color or intensity according to its 
spectral signature, e.g., in a predefined spectral range, thereby providing an image 
enhancing the spectral signatures of the eye tissue; and (d) using the image to 

15 evaluate the medical condition of the patient. The optical device can be integrally 
formed with the spectral imager. 

According to still further features in the described preferred embodiments 
the medical condition is selected from the group consisting of diabetic retinopathy, 
ischemia of the eye, glaucoma, macular degeneration, CMV eye infection, 

20 melanoma lesions, hemangioma lesions, retinitis, choroidal ischemia, acute 
sectorial choroidal ischemia, ischemic optic neuropathy, and corneal and iris 
problems. 

Further according to the present invention there is provided an apparatus for 
providing a display of an image presenting an eye tissue, wherein each pixel in the 
25 image is assigned a color or intensity according to a spectral signature of a tissue 
element from which it is derived, thereby enhancing the spectral signature of the 
eye tissue comprising (a) an optical device for eye inspection being optically 



wo 00/67635 



PCT/ILOO/00255 



20 

connected to a spectral imager, e.g., a high throughput spectral imager, (b) an 
illumination source for illuminating the eye tissue with light via the iris; and (c) an 
image display device for displaying the image; wherein the image is realized by 
viewing the eye tissue through the optical device and spectral imager and obtaining 
5 a spectrum of light for each pixel of the eye tissue; and further by attributing each 
of the pixels a color or intensity according to its spectral signature, e.g., in a 
predefined spectral range, thereby providing the image enhancing the spectral 
signatures (e.g., in full or parts thereof) of the eye tissue. 

According to still further features in the described preferred embodiments 
10 there is provided a spectral bio-imaging method for obtaining a spectrum of a 
region (corresponding to a pixel or few pixels in the image) of an eye tissue, the 
method comprismg the steps of (a) providing an optical device for eye inspection 
being optically connected to a spectral imager, e.g., a high throughput spectral 
imager; (b) illuminating the eye tissue with light via the iris, viewing the eye tissue 
15 through the optical device and spectral imager and obtaining a spectrum of light 
for each pixel of the eye tissue; and (c) displaying a spectrum (a spectrum of a 
single pixel or an average spectrum of several pixels) associated with the region of 
interest. Spectra of specific regions in the eye are known in the art, however using 
the above method enables a practitioner to precisely select a region of interest, 
20 such that the spectrum obtained is the spectrum of interest. The optical device can 
be integrally formed with the spectral imager. 

Further according to the present invention there is provided a spectral bio- 
imaging method for enhancing spectral signatures of at least two eye tissues, each 
of a different spectral signature, the method comprising the steps of (a) providing 
25 an optical device for eye inspection being optically connected to a spectral imager; 
(b) illuminating the eye tissue with light via the iris, viewing the eye tissue through 
the optical device and spectral imager and obtaining a spectrum of light for each 
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pixel of the eye tissue; and (c) selecting spectral ranges highlighting the different 
spectral signatures of each of the at least two eye tissues; and (d) generating an 
image enhancing the different spectral signatures of the at least two eye tissues. 
The optical device can be integrally formed with the spectral imager. 
5 Further according to the present invention there is provided a spectral bio- 

imaging method for enhancing blood vessels of an eye tissue, the method 
comprising the steps of (a) providing an optical device for eye inspection being 
optically connected to a spectral imager; (b) illuminating the eye tissues with light 
via the iris, viewing the eye tissue through the optical device and spectral imager 

10 and obtaming a spectrum of light for each pixel of the eye tissue; (c) employing an 
algorithm highlighting a spectral signature of blood vessels; and (d) generating an 
image enhancing the blood vessels. The optical device can be integrally formed 
with the spectral imager. 

Further according to the present invention there is provided an apparatus for 

15 providing a display of an image presenting an eye tissue in which blood vessels are 
enhanced by a color or intensity according to a spectral signature specific thereto, 
the apparatus comprising (a) an optical device for eye inspection being optically 
connected to a spectral imager; (b) an illumination source for illuminating the eye 
tissue with light via the iris; and (c) an image display device for displaying the 

20 image; wherein the unage is realized by viewing the eye tissue through the optical 
device and spectral imager and obtaining a spectrum of light for each pixel of the 
eye tissue; and further by attributing each of the pixels a color or intensity 
according to its spectral signature, thereby enhancing the spectral signature of 
blood vessels in the eye tissue. 

25 The present invention successfully addresses the shortcomings of the 

presently known configurations by providmg an image of the eye which enhances 
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spectral signatures of constituents thereof, characterized by high spatial and 
spectral resolutions. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention herein described, by way of example only, with reference to 
the accompanying drawings, wherein: 

FIG. 1 is a block diag^ram illustratmg the main components of an imaging 
spectrometer constructed in accordance with U.S. Pat. No. 5,539,517 (prior art). 

FIG. 2 illustrates a Sagnac interferometer, as used in an imaging 
spectrometer in accordance with U.S. Pat. No. 5,539,517 (prior art). 

FIG. 3 shows a definition of pseudo-RGB (Red, Green and Blue) colors for 
emphasizing chosen spectral ranges. The intensity for each pseudo-color is 
calculated by integrating the area under the curve, after multiplying it by one of the 
curves. 

FIG. 4a is a spectral image of a human right eye acquired using the 
SPECTRACUBE system. 

FIG. 4b is a spectral image of the human right eye of Figure 4a after spatial 
registration and spectral correction. 

FIG. 5a presents a portion of an interferogram function of a given pixel 
derived from the spectral image of Figure 4a. 

FIG. 5b presents a portion of an interferogram fimction of the same pixel of 
Figure 5a, which pixel is derived from the spectral image of Figure 4b. 

FIG. 6a presents spectra of five adjacent pixels derived from the spectral 
image of Figure 4a, the position of each pixel is indicated. 

FIG. 6b presents spectra of five adjacent pixels derived from the spectral 
imagie of Figure 4b, the position of each pixel is indicated. 

FIGs. 7a-f present the operation of a fiinges suppression algorithm. 
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FIGs. 8a and 8b presents a spectral image of a healthy retina. Spectrally 
distinct regions are designated in Figure 8b. 

FIG. 9 presents plots of hemoglobin extinction coefficients from the 
literature. 

5 FIG. 1 0 presents plots of inverted log of reflectivity spectra of a vem and an 

artery. 

FIG. 1 1 presents spectra of pixels from the disk, the cup, the retina, and a 
retinal vessel, as measured according to the present invention. 

FIG. 12 is a schematic cross section of the retina, demonstrating the 
1 0 reflection of different wavelengths from different retinal depths. 

FIGs. 13a-c compares plots of spectra extracted from several eye regions 
reported in the prior art (13a) with spectra measured according to the present 
invention of the same regions (13b) and of other regions (13c). 

FIGs. 14a-e present an RGB image, an enhanced RGB image, a 610 and 
15 564 nm images and a hemoglobin oxygenation image of portion of a retina 
including retinal blood vessels of a healthy individual. 

FIG. 15 presents plots of spectra derived from a hemorrhage and healthy 
retinal regions, according to the present invention. 

FIG. 16 presents plots of inverted log reflectivity spectra of normal, 
20 intermediate and degenerate macular tissue of a single patient suffering macular 
degeneration, as measured according to the method of the present invention. 

FIG. 17 presents an RGB image of a region in the macula of the patient of 
Figure 16. 

FIGs. 18a-d present an RGB image, a 610 and 564 nm images and a 
25 hemoglobin concentration image of an optic disk of a healthy individual. 
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FIGs. 19a-e present an RGB image, a 610 and 564 nm images, a 
hemoglobin concentration image and an image of an optic disk of a glaucoma 
patient. 

FIG. 20 presents a RGB image of the ocular fundus calculated on the basis 
5 of the spectra of each pixel as measured through a green filter by the 
SPECTRACUBE SD200 model attached to a fundus camera. The green filter is 
used to avoid saturation of the signals due to high response in the red and infrared 
wavelengths. 

FIG. 21 shows selected spectra of different features of the ocular fundus 
10 extracted from the spectral image measurement of Figure 20, and illumination 
spectrum of the source used, as measured by the SPECTRACUBE attached to a 
fundus camera and through the same green filter as before. Please note that the 
spectra of the features and the spectrum of the illumination are shown in a different 
scale: the features spectra are amplified in order to show more details. 
15 FIG. 22 shows logarithms of the inverse ratio of the spectra of the fundus 

features of Figure 21 divided by the illumination spectrum of Figure 20. These 
spectra do not depend on instrument response and illumination spectrum. 

FIG. 23 shows gray scale image extracted from the spectral image 
measurement of Figure 20 at 550 nm. 
20 FIG. 24 shows gray scale image extracted from the spectral image 

measurement of Figure 20 at 650 nm. 

FIG. 25 is a superimposition of choroidal vessels and retinal vessel system 
in one image, obtained by a specially designed algorithm, using the spectral image 
of Figure 20. 

25 FIG. 26 shows a retinal angiographic image of an optical disc and 

surrounding retinal tissue of a healthy individual in which blood vessels are 
contrasted due to injection of indocyanine green dye to the examined individual. 
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FIG. 27 shows a retinal angiographic image of an optical disc and 
surrounding retinal tissue of another healthy individual in which blood vessels are 
contrasted non-invasively using the absorption of intrinsic hemoglobin according 
to the presoit invention. 
5 FIG. 28 shows a retinal angiographic image of an optical disc and 

surrounding retmal tissue of a , patient suffering from age related macular 
degeneration in which blood vessels are contrasted due to injection of indocyanine 
green dye to the exammed individual. 

FIG. 29 shows a retinal angiographic image of an optical disc and 
10 surrounding retinal tissue of the patient of Figure 28 in which blood vessels are 
contrasted non-invasively using the absorption of intrinsic hemoglobin according 
to the present invention. 

FIGs. 30a-b demonstrates the user interface in which three regions (mariced 
1-3) are used: 1 - region of mterest; 2 - region including the boundaries of region 
15 1 ; and 3 - region including the surroundings. 

FIG. 31 demonstrates the process of slicing the region of interest with its 
surrounding into slices along the equator of the region of interest. A collection of 
measured -ln(/^ //w-,)is obtained (blue curves). A model fitting (red curves) to 
the measured dlniI„/I„.^)/dA is done for each slice separately accordmg to 
20 Equation 39. 

FIG. 12 show estimates of oxygen saturation in the different four slices (red 
curve) and the corresponding reliability weight in arbitrary units (blue curve). 
FIGs. 33a-b display oxygen saturation on retinal vessels of healthy eyes. 
FIGs. 34a-c display oxygen saturation on retinal vessels of eyes with 
25 pathologies. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is of a method for spectral bio-imaging of the eye 

which can be used for non-invasive early detection and diagnosis of eye diseases. 

Specifically, the present invention can be used for detection of spatial organization, 
5 distribution and quantification of cellular and tissue natural constituents, structures 

and organelles, tissue vitality, tissue metabolism, tissue viability, etc., using light 

reflection, scattering and emission, with high spatial and spectral resolutions. 

The principles and operation of a method according to the present invention 

may be better understood with reference to the drawings and accompanying 
10 descriptions. 

Before explaining at least one embodiment of the invention in detail, it is to 
be understood that the invention is not limited in its application to the details of 
construction and the arrangement of the components set forth in the following 
description or illustrated in the drawings. The invention is capable of other 

15 embodiments or of being practiced or carried out in various ways. Also, it is to be 
understood that the phraseology and terminology employed herein is for the 
purpose of description and should not be regarded as limiting. 

The present invention is of a spectral bio-imaging method for enhancing 
spectral signatures of an eye tissue (e.g., ocular fundus tissue, choroidal tissue, 

20 etc.). The method is effected executing the following method steps. First, an 
optical device for eye inspection, such as, but not limited to, a funduscope or a 
fimdus camera, which is optically connected to a spectral imager, e.g., a high 
throughput spectral imager, is provided. Second, the eye tissue is illuminated with 
light via the iris, the eye tissue is viewed through the optical device and spectral 

25 imager and a light spectrum for each pixel of the eye tissue is obtained. 

Third, each of the pixels is attributed a color or intensity according to its 
spectral signature, e.g., in a predefined spectral range, thereby an image enhancing 
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the spectral signatures of the eye tissue is provided. As used herein the term 
"spectral range" also refers to a single wavelength. As further described 
hereunder, it is sometimes advantageous to highlight different portions or tissues 
of the eye by using different spectral regions for different tissues or portions. 
5 For many of the embodiments according to the present invention any 

spectrar imager may be used to perform the measurement. Suitable spectral 
imagers include, for example, a filters based spectral imager, a monochromator 
(grating/prism) based spectral imager and or an interferometer based spectral 
imager. A description concerning the operation and construction advantages and 
10 disadvantages of each of these spectral imagers is provided m the Background 
section above and the Examples section that follows. 

However, some embodiments according to the present invention can be 
efficiently realized only with a high throughput spectral imager (see example 5 and 
the rational therein). 

15 As used herein in the specification and in the clauns section below, the term 

"high throughput" refers to an ability of a spectral imaging device to efficiently 
utilize available photons. It is based on an optical light collection concept which in 
order to provide spectral information, does not need to do either of the following: 
(i) filter out photons outside each wavelength of the spectral range of interest, as 

20 done by spectral imagers employing a plurality of narrow band filters; (ii) block 
the light coming fi-om pixels outside a narrow region of the image, as done by a 
spectral unager employmg a grating or prism, by a limiting slit. Thus, as used 
herein, the term refers to the ability of the part of the imager that provides the 
spectral inforaiation (e.g., wide band filters, decorrelation filters, interferometer) to 

25 collect at least about 30 %, preferably at least about 40 %, more preferably a least 
about 50 %, most preferably at least about 60 %, ideally, above about 60 %, say 
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between 60 % and the theoretical value of 100 %» of the photons to which the 
collection optics of the imager is exposed to. 

Examples of high throughput spectral imagers usefiil at implementing the 
method according to the present invention are provided in the Examples section 

5 below (see Example 1) 

According to a preferred embodiment of the invention the spectral imager 
includes an interferometer. In this case, step (b) above incliides, for example, the 
following: (i) collecting incident light simultaneously from all pixels of the eye 
using coUimating optics; (ii) passing the incident coUimated light through an 

10 interferometer system having a number of elements, so that the light is first split 
into two coherent beams which travel in different directions inside the 
interferometer and then the two coherent beams recombine to interfere with each 
other to fomi an exiting light beam; (iii) passing the exiting light beam through a 
focusing optical system which focuses the exiting light beam on a detector having 

15 a two-dimensional array of detector elements; (iv) rotating or translating 
(scanning) one or more of the elements of the interferometer system, so that an 
optical path difference between the two coherent beams generated by the 
interferometer system is scanned simultaneously for all the pixels; and (v) 
recording signals of each of the detector elements as function of time using a 

20 recording device to form a spectral cube of data. 

According to a preferred embodiment of the invention the two-dimensional 
array is selected from the group consisting of a video rate CCD, a cooled high 
dynamic range CCD, an intensified CCD and a time gated intensified CCD, 

Be it an interferometer based spectral imager or any other spectral imager, 

25 the light analyzed to derive a spectrum of each of the pixels of the eye tissue may 
be light reflected from the eye tissue, light scattered from the eye tissue and/or 
light emitted from the eye tissue. The light emitted from the eye tissue may be due 
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to administered probe fluorescence, administered probe induced fluorescence 

and/or auto-fluorescence of the eye tissue. 

Depending on the specific application and the spectral imager, the light 

used for illuminating the eye tissue is, for example, coherent light (e.g., laser), 
5 white light, filtered light, ultraviolet light, infrared light and a light having a small 

wavelength range (e.g., LED produced light). 

Any eye tissue is suitable for examination using the method of the present 

invention, including, but not limited to, eye retina, a retinal blood vessel, an optic 

disk, an optic cup, eye macula, fovea, cornea, iris, lens, nerve fiber layer, choroid, 
10 choroidal layer, choroidal blood vessel, pigment epithelium and Bruch's 

membrane. In many cases, the eye tissue includes blood vessels and the method 

serves for enhancing the vessels or for detecting and mapping the oxygenation 

level and/or concentration of hemoglobin along any of the blood vessel, veins 

and/or arteries. 

15 Effecting step (c) above may be accomplished m many ways, for example, 

using any of the algorithms described under Example 2 below. However, in a 
preferred embodiment step (c) is effected using a mathematical algorithm which 
computes a Red-Green-Blue color image or a gray level (scale) image using 
predefmed wavelength ranges, all as further described in the Examples section 

20 below. Thus, as used herein the term "color" refers also to black, gray and white. 

In a preferred embodiment of the invention, the spectral signature of the eye 
tissue and, as a result, the color of each pixel is affected by a substance such as 
hemoglobin, cytochromes, oxidases, reductases, flavins, nicotinamide adenine 
dinucleotide, nicotinamide adenine dinucleotide phosphate, collagen, elastin, 

25 xanthophyll and/or melanin. The color of each pixel represents the content or 
concentration of any one or more of these materials or, except for collagen, elastin. 
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xanthophyll and melanin, the ratio between their oxidized (e.g., o^Qrgenated, 
dehydrogenated) and reduced (e.g., hydrogenated, deoxygenated) forms. 

According to the present invention enhancing the spectral signatures of the 
eye tissue may include enhancement of physiological structures such as arteries 
5 and veins and/or levels of biological substances such as melanoma lesions, 
hemangioma lesions, hemoglobm concentration and oxygen saturation level, which 
is indicative to the level of metabolism and/or vitality of the tissue. 

According to another preferred embodiment of the invention the spectral 
imager employed includes an interferometer and a module for effecting a 
10 procedure for correcting spatial and spectral information for movements of the eye 
tissue via spatial registration and spectral correction. For other imagers, spatial 
registration, as well known in the art, can be employed, if so required. 
Mechanically and/or chemically fixating the analyzed eye obviates the need for 
these procedures, 

15 As is evident from the examples below, the method according to the present 

invention can be used for evaluating a medical condition of a patient. The medical 
evaluation method includes steps (a)-(c), substantially as described hereinabove 
and further includes a medical evaluation procedure using the image obtained. The 
medical condition may be any condition that affects the eye, including, but not 

20 limited to, diabetic retinopathy, ischemia of the eye, glaucoma, macular 
degeneration, CMV eye infection (cytomegalovirus eye infection of AIDS 
patients), CMV eye infection, melanoma lesions, hemangioma lesions, retinitis, 
choroidal ischemia, acute sectorial choroidal ischemia, ischemic optic neuropathy, 
and comeal and iris problems. 

25 Further according to the present invention there is provided an apparatus for 

generating a display which includes an image presenting an eye tissue, wherein 
each pixel in the image has a color or intensity according to a spectral signature of 
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a tissue element (part of a tissue which is equivalent to a pixel m the image, 
depending on spatial resolution) from which it is derived, thereby enhancing the 
spectral signatures of the eye tissue. The term "display" as used herein refers to 
any visual presentation such as, but not limited to, a photograph, a print, screen 
display or a monitor display, which can be materialized by a camera, a printer, a 
screen and a monitor, respectively. 

The apparatus thus includes (a) an optical device for eye inspection being 
optically connected to a spectral unager, e.g., a high throughput spectral imager; 

(b) an illumination source for illuminating the eye tissue with light via the iris; and 

(c) an image display device for displaying the image. The image is realized by 
viewing tfie eye tissue tiirough the optical device and spectral imager and obtaining 
a spectrum of light for each pixel of the eye tissue, and further by attributing each 
of the pixels a color or intensity accordmg to its spectral signature, e.g., m a 
predefined spectral range, tiiereby providing the image enhancing tiie spectral 
signatures of the eye tissue. 

Still fiirther according to the present invention there is provided a spectral 
bio-imaging method for obtaining a spectrum of a region (corresponding to a pixel 
or few pixels in the image) of an eye tissue. The metiiod is effected by executing 
the following metiiod steps. 

First, an optical device for eye inspection, such as, but not limited to, a 
funduscope or a fundus camera, which is optically connected to a spectral imager 
is provided. 

Second, the eye tissue is illuminated with light via tiie iris, tiie eye tissue is 
viewed through Uie optical device and spectral imager and a light spectrum for 
each pixel of the eye tissue is obtained. 

And tfiird, a spectrum (a spectrum of a single pixel or an average spectrum 
of several pixels) associated witii the region of interest is displayed. 
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Yet, still further according to the present invention there is provided a 
spectral bio-imaging method for enhancing spectral signatures of at least two eye 
tissues, each of a different spectral signature. The method is effected by (a) 
providing an optical device for eye inspection being optically connected to a 

s spectral imager; (b) illuminating the eye tissue with light via the iris» viewing the 
eye tissue through the optical device and spectral imager and obtaining a spectrum 
of light for each pixel of the eye tissue; and (c) selecting spectral ranges 
highlighting the different spectral signatures of each of the at least two eye tissues; 
and (d) generating an image enhancing the different spectral signatures of the at 

10 least two eye tissues. The applicability of this method is demonstrated in Example 
S below. The optical device can be integrally formed with the spectral imager. 

Further according to the present invention there is provided a spectral bio- 
imaging method for enhancing blood vessels of an eye tissue. The method is 
effected by (a) providing an optical device for eye inspection being optically 

IS connected to a spectral imager; (b) illuminating the eye tissues with light via the 
iris, viewing the eye tissue through the optical device and spectral imager and 
obtaining a spectrum of light for each pixel of the eye tissue; (c) employing an 
algorithm highlighting a spectral signature of blood vessels; and (d) generating an 
image enhancing the blood vessels. The applicability of this method is 

20 demonstrated in Example 6 below. The optical device can be integrally formed 
with the spectral imager. 

. Further according to the present invention there is provided an apparatus for 
providing a display of an image presenting an eye tissue in which blood vessels are 
enhanced by a color or intensity according to a spectral signature specific thereto. 

25 The apparatus includes (a) an optical device for eye inspection being optically 
connected to a spectral imager; (b) an illumination source for illuminating the eye 
tissue with light via the iris; and (c) an image display device for displaying the 
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image; wherein the image is realized by viewing the eye tissue through the optical 
device and spectral unager and obtaining a spectrum of light for each pixel of the 
eye tissue; and further by attributing each of the pixels a color or intensity 
according 1» its spectral signature, thereby enhancing the spectral signature of 
blood vessels in the eye tissue. The applicability of this apparatus is demonstrated 
in Example 6 below. 

Further according to the present invention there is provided a spectral bio- 
imaging method for extracting a spectral signature of a first portion of a layer of an 
object which includes at least two layers, wherein each of the two layers has 
different spectral characteristics. The method according to this aspect of the 
present invention is effected by implementing the following method steps, in 
which, in a first step, an optical device which is optically connected to a spectral 
imager is provided. Then, the object is illuminated with light and is viewed 
through the optical device and spectral imager. Thereby, a continuous spectrum of 
light for each pixel of the object is obtained. The continuous spectrum of light of 
each pixel of the object are then used for generating a spectral image of the object 
in which the first portion is identifiable. Thereafter, the first portion of the layer 
and a second portion which is adjacent to the first portion in the spectral image are 
identified. Finally, taking into account the spectral characteristics of the second 
layer, spectral signature of the furst portion is extracted. 

The above method can be employed, as fiirther detailed hereunder for 
evaluating the oxygenation state of a blood vessel. In one example, the object is an 
ocular fiuidus, the at least two layers include a retinal layer and a choroidal layer 
and the furst portion is a retinal blood vessel and a choroidal blood vessel. 

According to a preferred embodiment die method fiirther includes a step of 
markmg a mark indicative of the oxygenation state of the first portion on the 
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spectral image in context of the first portion. The mark can be an indicative color 
and/or a numerical value. 

In addition, according to preferred embodiments and for better and more 
accurate results^ the step of extracting the spectral signature of the first portion 

5 includes averaging over a plurality of the pixels. 

Further according to the present invention there is provided a method of 
evaluatmg a medical condition of a patient The method is effected by 
implementing the following method steps, in which, a spectral signature of a 
retinal or choroidal blood vessel of a retina or choroid of an eye is extracted by (a) 

lb providing an optical device being optically connected to a spectral imager; (b) 
illuminating the ^e with light, viewing the eye through the optical device and 
spectral imager and obtaining a continuous spectrum of light for each pixel of the 
eye; (c) using the continuous spectrum of light of each pixel of the eye for 
generating a spectral image of the eye in which the retinal or choroidal blood 

15 vessel is identifiable; (c) identifying in the spectral image the retinal or choroidal 
blood vessel and a tissue being adjacent to the retinal or choroidal blood vessel; (d) 
accounting for spectral characteristics of the tissue, extracting the spectral 
signature of the retinal or choroidal blood vessel; and (e) using the spectral 
signature to evaluate the medical condition of the patient. 

20 The implementation and use of the last two methods according to the 

present invention are further described and exemplified in Example 7 below. 

Further according to the present invention there is provided an apparatus for 
providing a display of an image presenting an eye tissue and a marking of an 
oxygenation state of at least one blood vessel therein. The apparatus according to 

25 this aspect of the present invention includes an optical device for eye inspection 
which is optically connected to a spectral imager. The apparatus further includes 
an illumination source for illuminating the eye tissue with light via the iris. The 
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apparatus further includes an image display device for displaying the image. The 
image itself is realized by viewing the eye tissue through the optical device and 
spectral imager and obtaining a spectrum of Ught for each pixel of the eye tissue; 
attributing each of the pixels a color or intensity according to its spectral signature, 
thereby providing the image enhancing the spectral signatures of tfie eye tissue; 
and further by marking in contort of the blood vessel(s) the oxygenation state 
thereof 

Reference in now made to the following examples, which together with the 
above descriptions, illustrate the invention. 

EXAMPLE 1 
THE MEASUREMENT APPARATUS 

Figure 1 is a block diagram illustrating the main components of a prior art 
imaging spectrometer disclosed in U.S. Pat No. 5,539,517. This imaging 
specuiometer is constructed highly suitable to implement the method of the present 
invention as it has high spectral (Ca. 4-14 ran depending on wavelength) and 
spatial (Ca. 30/M /wi where M is the effective microscope or fore optics 
magnification) resolutions. 

Thus, the prior art imaging spectrometer of Figure 1 includes: a collection 
optical system, generally designated 20; a one-dimensional scanner, as indicated by 
block 22; an optical path difference (OPD) generator or interferometer, as 
indicated by block 24; a one-dimensional or two-dimensional detector array, as 
indicated by block 26; and a signal processor and display, as indicated by block 28. 

A critical element in system 20 is the OPD generator or interferometer 24, 
which ou^uts modulated light corresponding to a predetermined set of linear 
combinations of the spectral intensity of the light emitted from each pixel of the 



wo 00/67635 



PCT/ILOO/00255 



36 

scene to be analyzed. The output of the interferometer is focused onto the detector 
array 26. 

Thus, ail the required optical phase differences are scanned simultaneously 
for all the pixels of the field of view, in order to obtain all the information required 
5 to reconstruct the spectrum. The spectra of all the pixels in the scene are thus 
collected simultaneously with the imaging information, thereby pemiitting analysis 
of the image in a real-time manner. 

The apparatus according to U.S. Pat. No. 5,539,517 may be practiced in a 
large variety of configurations. Specifically, the interferometer used may be 
10 combined with other mirrors as described in the relevant Figures of U.S. Pat. No. 
5,539,517. 

Thus, according to U.S. Pat. No. 5,539,517 alternative types of 
interferometers may be employed. These include (i) a moving type interferometer 
in which the OPD is varied to modulate the light, namely, a Fabiy-Perot 

15 interferometer with scanned thickness; (ii) a Michelson type interferometer which 
includes a beamsplitter receiving the beam firom an optical collection system and a 
scanner, and splitting the beam into two paths; (iii) a Sagnac interferometer 
optionally combined with other optical means in which interferometer the OPD 
varies with the angle of incidence of the incoming radiation, such as the four* 

20 min-or plus beamsplitter interferometer as further described in the cited U.S. patent 
(see Figure 14 there). 

Figure 2 illustrates an imaging spectrometer constructed in accordance with 
U.S. Pat. No. 5,539,517, utilizing an interferometer in which the OPD varies with 
the angle of incidence of the incoming radiation. A beam entering the 

25 interferometer at a small angle to the optical axis undergoes an OPD which varies 
substantially linearly with this angle. 
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In the interfoometer of Figure 2, all the radiation from source 30 in all the 
pixels, after being coUimated by an optical collection system 31, is scanned by a 
mechanical scanner 32. The light is then passed through a beamsplitter 33 to a 
first reflector 34 and then to a second reflector 35, which reflects the light back 

5 through the beamsplitter 33 and then through a focusing lens 36 to an array of 
detectors 37 (e.g., a CCD). This beam interferes with the beam which is reflected 
by 33, then by second reflector 35, and finally by first reflector 34. 

At the end of one scan, every pixel has been measured through all the 
OPD's, and therefore the spectrum of each pixel of die scene can be reconstructed 

10 by Fourier transformation. A beam parallel to the optical axis is compensated, and 
a beam at an angle (6) to the optical axis undergoes an OPD which is a fimction of 
the thickness of the beamsplitter 33, its index of refraction, and the angle 6. The 
OPD is proportional to 6 for small angles. By applying the appropriate inversion, 
and by careful bookkeeping, the spectrum of every pixel is calculated. 

15 In the configuration of Figure 2 the ray which is incident on the 

beamsplitter at an angle yfi 06 = 45* in Figure 2) goes through the interferometer 
with an OPD = 0, whereas a ray which is incident at a general angle ft - 6 
undergoes an OPD given by the following: 

20 OPD06,6,/,«) = /[(«2.sin2ofr»-6))0-5 . (r?.sn?-{fi.6ifi-^ + 2sin/&in6] (1) 

where fi is the angle of incidence of the ray on the beamsplitter; 6 is the angular 
distance of a ray from the optical axis or interferometer rotation angle with respect 
to the central position; / is the thickness of the beamsplitter; and n is the index of 
25 refraction of the beamsplitter. 

It follows fiiom Equation 1 that by scanning both positive and negative 
angles wiUi respect to the central position, one gets a double-sided mterferogram 
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for every pixel, which helps eliminate phase errors giving more accurate results in 
the Fourier transform calculation. The scanning amplitude determines the 
maximum OPD reached, which is related to the spectral resolution of the 
measurement The size of the angular steps determines the OPD step which is, in 

5 turn, dictated by the shortest wavelength to which the system is sensitive. In fact, 
according to the sampling theorem [see. Chamberlain (1979) The principles of 
interferometric spectroscopy, John Wiley and Sons, pp. 53-55], this OPD step must 
be smaller than half the shortest wavelength to which the system is sensitive. 

Another parameter which should be taken into accoimt is the finite size of a 

10 detector element in the matrix. Through the focusing optics, the element subtends 
a finite OPD in the interferometer which has the effect of convolving the 
interferogram with a rectangular function. This brings about, as a consequence, a 
reduction of system sensitivity at short wavelengths, which drops to zero for 
wavelengths equal to or below the OPD subtended by the element. For this reason, 

15 one must ensure that the modulation transfer function (MTF) condition is satisfied, 
i.e., that the OPD subtended by a detector element in the interferometer must be 
smaller than the shortest wavelength at which the instrument is sensitive. 

Thus, imaging spectrometers constructed in accordance with the invention 
disclosed in U.S. Pat. No. 5,539,517 do not merely measure the intensity of light 

20 coming firom every pixel in the field of view, but also measure the spectrum of 
each pixel in a predefined wavelength range. They also better utilize all the 
radiation emitted by each pixel in the field of view at any given time, and therefore 
permit, as explained above, a significant decrease in the frame time and/or a 
significant increase in the sensitivity of the spectrometer. Such imaging 

25 spectrometers may include various types of interferometers and optical collection 
and focusing systems, and may therefore be used in a wide variety of applications. 
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including medical diagnostic and therapy and biological research applications, as 
well as remote sensing for geological and agricultural investigations, and the like. 

As mentioned above, an imaging spectrometer in accordance with the 
invention disclosed in U.S. Pat No. 5.539.517 was developed by AppUed Spectral 
Imaging Ltd., Industrial Park, Migdal Haemek, Israel and is referred herein as 
SPECTRACUBE. 

The SPECTRACUBE system optically connected to a microscope is used to 
implement the method for chromosome classification of the present invention. 
The SPECTRACUBE system has the following or better characteristics, listed 
hereinbelow in Table 1 below. 

The prior art SPECTRACUBE system was used, in accordance with the 
present invoition, to acquire spatially organized spectral data from the eye. 

The prior art SPECTRACUBE system was used, in accordance with the 
present invention, to acquire spatially organized spectral data from the eye. 
However, it will be appreciated that any spectral imager, i.e., an instrument that 
measures and stores m memory for later retiieval and analysis the spectrum of light 
emitted by eveiy point of an object which is placed in its field of view, including 
filter (e.g., acousto-optic tunable filters (AOTF) or liquid-crystal tunable filter 
(LCTF)) and dispersive element (e.g., grating or prism) based spectral imagers, or 
other spectral data or multi-band collection devices (e.g., a device in accordance 
with the disclosure m Speicher R. M., Ballard S. G. and Ward C. D. (1996) 
Karyotyping human chromosomes by combinatorial multi-fiour FISH. Nature 
gaieties, 12:368-375) can be used to acquire the required spectral data. Therefore, 
it is intended not to limit the scope of the present invention for use of any specific 
type of spectral data collection devices, nor any specific type of spectral imager. 
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Parameter 



Performance 



5 



Spatial resolution: 



30/M //m (M=efifective microscope or fore 
optics magnification) 
15/M millimeters 

20 milliLux (for 1 00 msec integration time, 
increases for longer integration times linearly 
with>/T) 
400-1000 nm 

4 nm at 400 nm (16 nm at 800 nm) 
5-50 sec, typical 25 sec 
20-180 sec, typical 60 sec 



Field of View: 
Sensitivity: 



10 



Spectral range: 
Spectral resolution: 
Acquisition time: 
FFT processing time: 



15 



As mentioned above, the SPECTRACUBE system easily attaches to any 
microscope or macro lens with, for example, C-moimt or F-mount connectors, and 
can stand in any orientation during the measurement. The system may as well be 
connected to other magnification means and to various types of endoscopes and 
20 cameras including funduscopes and fundus cameras* Therefore, spectral images of 
the eye tissue in various magnification and lighting may be obtained. 

For some applications according to the present invention (see Example 4) a 
high throughput spectral imager is required. 



25 based on Fourier Transform interferometry have been described in U.S. Pat. No. 
5,539, 517, of which the imager based on a Sagnac interferometer has been 
commercialized by Applied Spectral Imaging Ltd., and sold as the 
SPECTRACUBE™ models SD 200 and 300. Many other publications describing 
the SPECTRACUBE and several of its applications have been published during 

30 the last three years (see above). The feature distinguishing high throughput 
spectral imagers from other types, such as those based on filtering the reflected, 
transmitted or emitted light with narrow band filters or dispersing it with a grating 



Thus, various possible configurations of a high throughput spectral imager 
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or a prism, is that the fonner type makes a more efficient use of the photons 
available for measurement, especially when the origin of noise is random and is 
independent of signal (see R. J. Bell, Introductory Fourier Transform 
Spectroscopy^ Academic Press 1972, pp. 23-25 and J, Chamberlain, The Principles 

5 of Interferometric Spectroscopy^ John Wiley & Sons 1979, pp. 305-306, m 
reference to Fourier Transform Spectroscopy versus filters or grating 
spectroscopy), and m certain cases of photon shot noise limitations. 

Another high throughput Fourier transform spectral imaging system is 
distributed by BioRad Laboratories under the trade name of STINGRAY 6000. 

10 This system is described in "Fourier Transform Spectroscopic Imaging Usmg an 
Infixed Focal-Plane Array Detector", by E. Neil Lewis et al.. Analytical 
Chemistry, Vol. 67, No. 19, October 1, 1995, pp. 3377-3381. Its histopathological 
applications are described in Infixed Spectroscopic Imaging as a Tool for 
Pathology, by Linda H. Kidder et aL, SPIE Proceedings Vol. No. 3257, pp. 178- 

15 1 86. Both references are incorporated by reference as if fully set forth herem. 

Other types of high throughput spectral imagers are described in U.S. Pat. 
No. 5,719,024, which is incorporated by reference as if fully set forth herein and 
relates to matched decorrelation filters of wide spectral coverage. 

As taught by U.S. Pat. application No. 08/917,213, which is incorporated by 

20 reference as if fully set forth herein, other types of high throughput spectral 
imagers are based on different sets of wide band filters whose spectral 
transmission characteristics are chosen according to predetermined criteria, 
suitable for each specific application. The technology on which these filters are 
based can be of many types, e.g., interference filters, multilayer interference filters, 

25 narrow band and wide band filters, Liquid Crystal Filters, Acousto-Optic Tunable 
Filters, stained glasses, cut-ons, cut-offs, and others, and all the combinations 
thereof 
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U.S. Pat. application 09/143,964, filed August 30, 1998, which is 
incorporated by reference as if fully set forth herein, teaches monochromatic 
illumination of the sample by an array of LED sources combined with dispersion 
by grating. 

5 All of the these high throughput spectral imagers are suitable or readily 

adapted for use in combination with a fundus camera as described in U.S. Pat. 
application Nos. 08/942,122 and 09/143,964. 

It will be appreciated that researchers have tried the use of narrow band 
filters for monochromatic imaging of the retina and/or ocular fundus in the past, 

10 without success. It is assumed that the photon rejection of such instrumentation is 
so high that the measurement tune at each wavelength is too long for a meaningful 
result to be obtained in a reasonable time, due to eye movement and other practical 
constraints. In principle, these difficuhies may be overcome using specially 
designed algorithms or other solutions, but because of their complexity, 

IS development time, etc., the barriers encountered have been discouraging enough 
that no commercial instrumentation of this type is available today. 

In any case, to conduct the present study the SPECTRACUBE system was 
mounted on the CCD port of a fundus camera (Zeiss Model RC-310) and the 
combined system was situated such that the optical path was substantially 

20 horizontal. This facilitates eye inspection, wherein the patient is seated. A white 
light source was used for illumination of the eye and reflected light was collected 
and analyzed. 
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EXAMPLE 2 

DISPLAY AND ANALYSIS OF SPECTRAL IMAGES 
a. General 

As mentioned above, a q)ectral image is a three dimensional array of data, 
I(x.y.^, that combines spectral information with spatial organization of the image. 

As such, a spectral image is a set of data called a spectral cube, due to its 
dimensionality, which enables the extraction of features and the evaluation of 
quantities that are diflRcult, and in some cases even impossible, to obtain 
otherwise. 

Since both spectroscopy and digital image analysis are well known fields 
that are covered by an enormous amount of literature [see, for example, Jain 
(1989) Fundamentals of Digital Image Processing, Prentice-Hall International], the 
following discussion will focus primarily on the benefit of combining 
spectroscopic and imaging inf<nmation in a single data set i.e., a spectral cube. 

One possible type of analysis of a spectral cube is to use spectral and spatial 
data separately, i.e., to apply spectral algorithms to the spectral data and two- 
dimensional image processing algorithms to the spatial data. 

As an example for a special algorithm consider an algorithm computing the 
similarity between a reference spectrum and the spectra of all pixels (i.e., similarity 
mapping) resulting in a gray (or other color) scale image (i.e., a similarity map) in 
which the intensity at each pfatel is proportional to the degree of 'similarity'. 

This gray scale image can then be fiirther analyzed using image processing 
and computer vision techniques (e.g., image enhancement, pattern recognition, 
etc.) to extract the desired features and parameters. 

In other words, similarity mapping involves computing the integral of the 
absolute value of the difference between the spectrum of each pixel of the spectral 
image with respect to a reference spectrum (either previously memorized in a 
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library, or belonging to a pixel of the same or other spectral image), and displaying 
a gray level or pseudocolor (black and white or color) image, in which the bright 
pixels correspond to a small spectral difference, and dark pixels correspond to a 
large spectral difference, or vice versa. 
5 Similarly, classification mapping perform the same calculation as described 

for similarity mapping, yet takes several spectra as reference spectra, and paints 
each pixel of the displayed image with a different predetermined pseudocolor, 
according to its classification as being most similar to one of the several reference 
spectra. 

10 It is also possible to apply spectral image algorithms based on non- 

separable operations; i.e., algorithms that include both local spectral information 
and spatial correlation between adjacent pixels (one of these algorithms is, as will 
be seen below, a principal component analysis). 

One of the basic needs that arise naturally when dealing with any three- 

15 dimensional (3D) data structure such as a spectral cube (i.e., /(x^y,A)), is 
visualizing that data structure in a meaningful way. Unlike other types of 3D data 
such as topographic data, D(x,y,z), obtained, for example, by a confocal 
microscope, where each point represents, in general, the intensity at a different 
locations {x,y,z) in tree-dimensional space, a spectral image is a sequence of 

20 images representing the intensity of the same two-dimensional plane (i.e., the 
sample) at different wavelengths. For this reason, the two most intuitive ways to 
view a spectral cube of data is to either view the image plane (spatial data) or the 
intensity of one pixel or a set of pixels as function of wavelength in a three- 
dimensional moimtain-valley display. In general, the image plane can be used for 

25 displaying either the intensity measured at any single wavelength or the gray scale 
image that results after applying a spectral analysis algorithm, over a desired 
spectral region, at every image pixel. The spectral axis can, in general, be used to 
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present the resultant spectrum of some spatial operation performed in the vicinity 
of any desired pixel (e.g., averaging the spectrum). 

It is possible, for example, to display the spectral image as a gray scale 
image, similar to the image that might be obtained fix^m a simple monochrome 
5 camera, or as a multicolor image utilizing one or several artificial colors to 
highlight and map important features. Since such a camera simply integrates the 
optical signal over the spectral range (e.g., 400 nm to 760 nm) of the CCD array, 
the ^equivalent' monochrome CCD camera image can be computed from the 3D 
spectral image data base by integrating along the spectral axis, as follows: 

10 

x\ 

griay^scaleix.y) = jw(Z) - Iix,y,A)dX (2) 

In equation 2, w(A) is a general weighting response function that provides 
maximum flexibility in computing a variety of gray scale images, all based on the 

15 integration of an appropriately weighted spectral image over some spectral range. 
For example, by evaluating equation (2) with three different weighting functions, 
{wr(^), Wg(AX \^b(V}^ corresponding to the tristimulus response functions for red 
(R), green (G) and blue (B), respectively, it is possible to display a conventional 
RGB color unage. It is also possible to display meaningful non-conventional color 

20 images, wherein the weighting functions differ from RGB. Figure 3 presents an 
example of the power of this simple algorithm. Consider choosmg {w^., Wg, w^} 
to be Gaussian functions distributed "inside" a spectrum of interest, the resulting 
pseudo-color image that is displayed in this case emphasizes only data in the 
spectral regions corresponding to the weighting functions, enabling spectral 

25 differences in these three regions to be detected more clearly. 
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b. Point operations 

Point operations are defined as those that are performed on single pixels, 
(i.e., do not involve more than one pixel at a time). For example, in a gray scale 
image, a point operation can be one that maps the intensity of each pixel (intensity 
function) into another intensity according to a predetermined transformation 
function. A particular case of this type of transformation is the multiplication of 
the intensity of each pixel by a constant 

The concept of point operations can also be extended to spectral images: 
here each pixel has its own intensity function (spectrum), i.e., an n-dimensional 
vector V\{A,); Ae[Ai, An]. A pomt operation applied to a spectral image can be 
defined as one that maps the spectrum of each pixel into a scalar (i.e., an intensity 
value) according to a transformation function: 

v2 = g(^l(A));A€[Al,An](3) 

Building a gray scale image according to Equation 3 is an example of this 
type of point operation. In the more general case, a point operation maps the 
spectrum (vector) of each pixel into another vector according to a transformation 
fimction: 

VliO = giVlWy. /e[l, //], An] (4), where 7\^< n. 

In this case a spectral image is transformed into another spectral image. 

One can now extend the definition of point operations to include operations 
between corresponding pixels of different spectral images. An important example 
of this type of algorithm is optical density analysis. Optical density is employed to 
highlight and graphically represent regions of an object being studied 
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spectroscopically with higher dynamic range than the transmission spectrum. The 
optical density is related to transmission by a logarithmic operation and is therefore 
always a positive function. The relation between the optical density and the 
measured spectra is given by Lambert Beer law: 



where OD(X) is the optical density as a function of wavelength, /(A.) is the 
measured spectrum, Iq(JI) is a measured reference spectrum, and t(;i) is the 
spectral transmitance of the sample. Equation 5 is calculated for every pixel for 
every wavelength where loiX) is selected from (i) a pixel in the same spectral cube 
for which OD is calculated; (ii) a corresponding pixel in a second cube; and (iii) a 
spectrum from a library. 

Note that the optical density does not depend on either the spectral response 
of the measuring system or the non-uniformity of the CCD detector. This 
algorithm is useful to map the relative concentration, and in some cases the 
absolute concentration of absorbers in a sample, when their absorption coefficients 
and the sample thickness are known. It should thus be noted that the term "level" 
as used hereinbelow in the clahns section also refers to the terms "amount", 
"relative amount", "absolute concentration" and "relative concentration". 

Additional examples include various linear combination analyses, such as 
for example: (i) applying a given spectrum to the spectrum of each of the pixels in 
a spectral image by an arithmetical function such as addition, subtraction, 
multiplication, division and combinations thereof to yield a new spectral cube, in 
which the resulting spectrum of each pixel is the sum, difference, product ratio or 
combination between each spectrum of the first cube and the selected spectrum; 
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and (ii) applying a given scalar to the spectra of each of the pixels of the spectral 
image by an arithmetical function as described above. 

Such linear combmations may be used, for example^ for background 
subtraction in which a spectrum of a pixel or, preferably, the average spectrum of 

5 some or all of the pixels located in the background region is subtracted from the 
spectrum of each of the other (non-background) pixels; and for a calibration 
procedure in which a spectrum measured prior to sample analysis is used to divide 
the spectrum of each of the pixels in the spectral image. 

Another example includes a ratio image computation and display as a gray 

JO level image. This algorithm computes the ratio between the intensities at two 
different wavelengths for every pixel of the spectral image and paints each of the 
pixels in a lighter or darker artificial color accordingly. For example, it paints the 
pixel bright for high ratio, and daric for low ratio (or the opposite), to display 
distributions of spectrally sensitive materials. 

IS c Spatial-spectral combined operations 

In all of the spectral image analysis methods mentioned above, algorithms 
are applied solely to the spectral data. The importance of displaying the spectrally 
processed data as an image is mostly qualitative, providing the user with a useful 
image. It is also possible, however, depending on the application, to use the 

20 available imaging data in even more meaningful ways by applying algorithms that 
utilize the spatial-spectral correlation that is inherent in a spectral image. Spatial- 
spectral operations represent the most powerful types of spectral image analysis 
algorithms. As an example, consider the following situation: 

A sample contains k cell types stained with k different fluorophores (the 

25 term *ceir here is used both for a biological cell, and also as 'a region in the field of 
view of the instrument'). Each fluorophore has a distinct fluorescence emission 
spectrum and binds to only one of the k cell types. It is important to find the 
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average fluorescence intensity per cell for each one of the k cell types. To achieve 
this task the following procedure can be used: (i) each pixel in the image is 
classified as belonging to one of A+1 classes {k cell types plus a background) 
according to its spectrum; (ii) the image is segmented into the various cell ^s 

5 and the number of cells from each Qpe is counted; and (iii) the fluorescence 
energy contributed by each class is summed and divided by the total number of 
cells from the corresponding class. 

This procedure makes use of both spectral and spatial data. The relevant 
spectral data takes the form of characteristic cell spectra (i.e., spectral 

10 "signatures"), while the spatial data consists of data about various types of cells 
(i.e., cell blobs) many of which appear similar to the eye. The ideal type of 
measurement for this type of situation is a spectral image. In the above situation, 
cells can be differentiated by then- characteristic spectral signature. Hence, a 
suitable point operation will be performed to generate a synthetic image in which 

15 each pixel is assigned one of k-^1 values. Assuming that the fluorescence emission 

spectra of the different cell types are known to be sfHX); / = 1, 2 , k, Xb[X\, X 

n], and the measured spectrum at each pixel (x, y) is Sx,yiX), X&[X\, X^, then the 
following algorithm is a possible method of classification (step 1 above): 

Let e^i be the deviation of the measured spectrum from the known spectrum 

20 of the fluorophore attached to cell type /. Then, adopting a least-squares "distance" 
definition, one can write: 

ej ^ I(s(X)-Si(X))^ (6) 

25 where Rx is the spectral region of interest. Each point [pixel (x, y)] in the image 
can then be classified into one of the k+\ classes using the following criterion: 



wo 00/67635 



PCT/ILOO/00255 



50 



pomt(xj^) e class A+1 if e2/> tbreshold for all i € [1,*], 

whereas (7) 

point(xj^) € class p \te^i < threshold, and p is such that min[e^j\= e^p 

Steps ii and iii above (iniage segmentation and calculation of average 
fluorescence intensity) are now straightforward using standard computer vision 
operations on the synthetic image created in accordance with the algorithm 
described in equations 6 and 7. 

Another approach is to express the measured spectrum Sx^y/iX) at each pixel 

as a linear combination of the k known fluorescence spectra SjjiX)\ / = 1, 2, , k. 

In this case one would find the coefficient vector C = [cj, C2» , that solves: 

F = min Z(s(X) -s(X)f (8) 

^ k 
where s{X) = 'SfiX), 

Solving for — =0;for / =7,2,...,fc(i.e., find values of c/ which minimize F) 
yields the matrix equation C= A'^B (9), where i4 is a square matrix of dimension k 



with elements 



(10), and B is a vector defined as 



L^*^' J, m,w==l,2,..,J 



,* (11). 

Arithmetic operations may similarly be applied to two or more spectral 
cubes and/or spectra of given pixels or from a library. For example consider 
applying an arithmetic operations between corresponding wavelengths of 
corresponding pairs of pixels belongmg to a first spectral cube of data and a 
second spectral cube of data to obtain a resulting third spectral cube of data for the 
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purpose of, for example, averaging two spectral cubes of data, time changes 
follow-up, spectral normalization, etc. 

In many cases objects present in a spectral image differ &om one another in 
chemical constituents and/or structure to some degree. Using a principal 
component analysis by producing covariance or correlation matrices enhances 
these small differences. 

A brief description of the principal component analysis using a covariance 
matrix is given below. For further details regarding the principal component 
analysis, the reader is referred to Martens and Naes (1989) Multivariate 
Calibration, John Wiley & Sons, Great Britain; and to Esbensen et al, Eds. (1994) 
Multi variance analysis - m practice. Computer-aided modeling as CAMO, and the 
Unscrambler's User's guide, Trondheim, Norway. 

Thus, the intensities of the pixels of the image at wavelength X\ (i = 1,...N) 
are now considered a vector whose length is equal to the number of pixels q. Since 
there are N of these vectors, one for every wavelength of the measurement, these 
vectors can be arranged in a matrix B' with q rows, and N columns: 



No. of wavelengths 




= No. of pixels 



(12) 




For each of the colunms of matrix B' defmed 



IS an average: 



Wj-/=7.....A^ (13) 



and a second normalized matrix B defined as: 
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No. of wavelengths 

m • 

B - No. of pixels • (14) 

• • ' /U^ 



A covariance matrix C is defined for the matrix B:C - B'^B of dimensions 
5 NxN. C is diagonalyzed, and eigenvectors and eigenvalues related by: O Vi = fif F/ 
where Vi are N orthogonal unit vectors and /i/ are the eigenvalues representing the 
variance in the direction of the z-th unit vector F/. In general, the lowest 
components represent the highest variability as a function of pixels. 

The products BYf (/ = 1,..JV) are the projections of the spectral image onto 
10 the elements of the orthogonal basis, and can be displayed separately as black and 
white images. These images may reveal features not obvious from a regular black 
and white image filtered at a certain wavelength. 



EXAMPLE 3 

15 SPECTRAL IMAGING OF MOVING OBJECTS 

According to the present invention provided are spectral unages of the eye 
collected preferably by an interferometer based spectral imager. 

Since, in order to perform a measurement, an interferometer based spectral 
unager must collect several frames of an examined object in a period of time that 
20 varies from ca. 5 to 60 seconds, a considerably longer period of time as compared 
with a camera or video camera snapshot, spectral imaging of moving objects, like 
the eye results in blurring of the image of the object and in disrupting the algorithm 
used to calculate the spectrum of each pixel thereof 
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Indeed, while using the s^paratus disclosed in U.S. Pat. No. 5,539,517 one 
should ensure that the examined object is substantially stationary for best results. 

This is indeed the case m many applications, such as when spectral unaging 
is used for color karyotyping and color banding of chromosomes as dbclosed in 
5 Schroeck et aL (1996) Multicolor spectral karyotyping of human chromosomes. 
Science 273:494-497. However, in other applications spectral imaging of a 
moving object is required. This is the case for example when the examined object 
is an organ of a living creature (e.g., a human eye or a specific region or tissue 
thereoO. 

10 Any attempt to measure a spectral image of a living organ, which organ is 

not motionless, will result in artifacts and a distorted or particularly noisy spectral 
image data. If such an image is acquired using filter or grating based spectral 
imagers, a spatial image registration procedure will be required for best results. 
Nevertheless, these spectral imagers suffer limitations as described in the 

1 s background section and are therefore less preferred. 

On the other hand, should such an image be acquired by an interferometer 
based spectral imager which have numerous advantages over other spectral 
imaging systems, not only spatial registration but also spectral correction is 
required. 

20 PCTAJS97/08153, filed May 12, 1997, which is incorporated by reference 

as if fully set forth herein, teaches spatial registration and spectral correction for 
interferometer based spectral imaging. 

U.S. Pat No. 5,539,517 and other publications [e.g., (i) Schroeck et al. 
(1996) Multicolor spectral karyotyping of human chromosomes. Science 273:494- 

25 497; (ii) Malik et aL (1996) Fourier transform multipixel spectroscopy for 
quantitative cytology. J. of Microscopy 182:133-140; (iii) Malik and Dishi (1995) 
ALA mediated PDT of melanoma tumors: light-sensitizer interactions determined 
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by a novel spectral imaging system. Proceedings of optical methods for tumor 
treatment and detection: Mechanisms and techniques in photodynamic therapy IV, 
Feb. 4-5, 1995. San Jose, CA, SPIE Vol. 2392, pp. 152-158; (in) Malik et al. 
(1994) A novel spectral imaging system combining spectroscopy with imaging - 

5 application for biology. Proceedings of optical and imaging techniques in 
biomedicine, Sep. 8-9, 1994, Lille, France, SPIE Vol. 2329, pp. 180-184; (iv) 
Malik et al. (1996) Fourier transform multiplex spectroscopy and spectral imaging 
of photopoiphyrin in single melanoma cells. Photochemistry and photobiology 
63:608-614; and (v) Soenksen et al (1996) Use of novel bio-imaging system as an 

10 imaging oximeter in intact rat brain. Proceedings of advances in laser and light 
spectroscopy to diagnose cancer and other diseases Til, Jan. 29-30, 1996, San Jose 
CA, SPIE Vol. 2679, pp. 182-189] teach spectral imaging devices and methods, in 
which the light from a surface of an examined object is collected by an optical 
aperture or field lens, passed through an interferometer, in which it is split into two 

15 coherent rays, and then it is focused by focusing optics onto a two-dunensional 
detector array device (e.g. a CCD in the UV to visible range) having a surface of 
detector elements, such that the detector's surface represents a real image of the 
object's surface. 

The signals from each and all detector elements of the detector array, as 
20 obtained from many successive frames of the detector array, are recorded, while 
the interferometer is scanned in synchronization with the detector frames. 

Since at each position of the interferometer, the optical path difference 
(OPD) between the two split beams through which a detector element sees its 
corresponding picture element (pixel) varies in a known way, at the end of the 
25 scan, the signals collected for each pixel form a frmction called interferogram, 
which is the intensity of light as function of the optical path difference (OPD) for 
that particular pixel. Because the interferometer speed is constant, the CCD frame 
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time is constant and the OPD is proportional to the interferometer angular position, 
the OPD samples are equally spaced. 

According to the well known teachings of the Fourier transform 
spectroscopy, the mathematical Fourier transform operation applied to this 
interferogram function yields a spectrum, i.e., the intensity of light in every 
wavelength emitted by the pixel in question. 

Since interferogram functions are known for every pixel of the object's 
surface, spectra can be calculated and known for every pixel thereof, by applying 
the Fourier transformation to all of the mterferograms thus collected. 

U.S. Pat No. 5,539,517 teach several embodiments of spectral imaging 
devices and methods, each is capable of measuring a spectral image of an object, 
which devices differ from one another in the type of interferometer used therein. 

It is well known that, in general, no matter what interferometer is used, at 
any one position of the interferometer scan, the OPD is different for an on-axis and 
an off-axis ray, and as a consequence, the OPD differs from pixel to pixel in the 
same frame. 

For example, as explained in "The principles of interferometric 
spectroscopy" by John Chamberiain, John Wiley & Sons, 1979, page 217, 
Equations 8.1a and 8.1b, in a Michelson interferometer the OPD varies according 
to the following Equation: 

(15) OPDa = OPDxcosa 

where a is the angle between the on-axis and the off-axis rays. 

According to Equation 15, the OPD dependence on the specific pixel is 
relatively low. In fact, in Equation 15, a is a small angle, and therefore the term 
(cosa) varies slowly as a^. 
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However, in a triangular interferometer such as that shown in Figure 2, the 
OPD varies faster, i.e., linearly with the projection of the angle of mcidence of the 
ray in the horizontal direction (equivalent to the projection of the distance of the 
corresponding pixel from the center of the image in the horizontal direction) as 
shown in Equation 31 in column 13 of U.S. Pat No. 5,539,517. 

This fact has two important consequences for an interferometer based 
spectral imager. 

First, one has to keep track of the OPD for every pixel and every detector 
frame, so that at the end of the scan, it is possible to reconstruct the spectrum 
through the Fourier Transform algorithm. This is done by knowing (i) the 

Second, should the examined object move during the measurement, the 
spatial registration of the various frames is lost, and the actual OPD of each pixel 
in each frame is different than it would have been should the object be still. Thus, 
if a spectral image of that object is calculated while neglecting its movements 
during the measurement, and the object is displayed using the collected data, for 
example via a Red-Green-Blue (RGB) ftmction defmed over some or all the 
spectral range, then (i) the image will look blurred due to loss of spatial 
registration during the measurement, and (ii) the calculated spectra will not 
represent the actual spectra, these spectra will look very noisy and not consistent 
due to the use of incorrect (i.e., non-registered) OPDs in the Fourier 
transformation. 

Before turning to the description of the method for spatial registration and 
spectml correction for interferometer based spectral imaging which can be used to 
obtain spectral images of moving objects, the prior art method for measurement of 
a stationary object will be described. 

Thus, a measurement of a stationary objects include the following steps. 
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First, the spectral imaging device is aligned and focused with respect to the 
examined object. 

Second, the interferometer is scanned in equally spaced OPD steps, while 
acquiring and storing successive frames of the object by the CCD. 
5 Third, the data is ordered (e.g., by a software) into an interferogram 

function for every pixel of the object's image. 

Fourth, preferably some well known preprocessing steps called windowing 
or apodization (see. Chamberlain (1979) The prmciples of interferometric 
spectroscopy, John Wiley and Sons, pp. 131 and following pages) are performed, 
10 in order to regularize the data such that the data of the measurement, which is a 
discrete and finite set of data, can be used instead of a theoretical contmuous 
interferogram function. 

Fifth, "zero filling" procedure is typically performed, such that the number 
of data for each interferogram is completed to a number of points which equals a 
15 power of two of the original number of data, in order to fill-in the spectrum with 
more interpolated points and to use fast Fourier transform algorithms (see, 
Chamberlain (1979) The principles of interferometric spectroscopy, John Wiley 
and Sons, pp. 31 1 and following pages). 

Sixth, the complex (real and imaginary parts) Fourier transforms are 
20 calculated by applying the fast Fourier transform algorithm on each of the 
interferograms. Alternatively, yet less preferably, a straight Fourier transform 
algorithm is applied. In the latter case "zero filling" is not required. 

Seventh, the spectrum of every pixel is calculated as the module (length) of 
the complex function so obtained, a function defined on discrete values of a 
25 conjugate parameter to the OPD, the wavenumber a, which in turn is the reciprocal 
of the wavelength: a = l/X. 



wo 00/67635 



PCT/IL00/0025S 



58 

The fast Fourier transform algoritibm reduces veiy considerably the 
calculation time but it can be used only when the OPD's are equally spaced and 
when the number of points in which the interferogram is defined equals to a power 
of two. For this reason the straightforward Fourier transfomi algorithm is 
5 generally not used. 

The method for spatial registration and spectral correction for 
interferometer based spectral imaging which can be used to obtain spectral images 
of moving objects is described hereinafter. 

The following description concerns an object that moves rigidly and linearly 
10 on a plane substantially perpendicular to the line of sight of the imager in a random 
or non-random movement. In other words the object moves in such a way that all 
of its parts keep their shape and size, and their relative distances, as seen through 
the spectral imager. 

Thus, in the case of a rigidly moving object in random directions without 
15 changing plane, (i.e., without getting closer or farther from the instrument, so that 
the object remains in focus), the measurement steps according to the method of the 
present invention are as follows. 

First, the spectral imaging device is aligned and focused with respect to the 
examined object. 

20 Second, the interferometer is scanned in synchronization with the CCD 

frames and constant speed, while acquiring and storing successive frames of the 
object by the CCD. However, contrary to the above prior art description, due to 
the object's movements, the resulting OPD steps are inherently not equally spaced 
as described above. The difference between successive OPD's is now random: it 

25 is the result of the combined motion of the interferometer and of the object, it can 
increase or decrease depending on the instantaneous position and velocity of the 
object with respect to the position and velocity of the interferometer, it can even be 
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negative (meaning decreasing OPD from a data point to the next) and, if the 
movement is larger than the field of view, or the movement is a sudden 
displacCTient larger than the field of view with immediate return to the previous 
position, a data point can be missing altogether. In some regions of the OPD axes 
5 tiie data points will be dense, in others they will be sparse. 

Third, the data is ordered (e.g., by a software) into an interferogram 
function for every pixel of the image. However, now the book-keeping is more 
complicated. In order to accomplish this step one must first find tiie spatial 
translation vector of all the frames measured, with respect to a frame taken as 

10 reference. This way the actual OPD for every pixel in each fiame can be found. 
Since this is a crucial step of the method according to the present invention it is 
described in more detail hereinbelow. 

Fourth, preferably some well known preprocessing steps called windowing 
or apodization are performed, in order to regularize the data such that the data of 

15 the measurement which is a discrete data can be used instead of a theoretical 
continuous mterferogram frmction. 

Fifth, here the method splits into two alternative branches. According to the 
first, the measured interferogram of each pixel is not fiirther interpolated and will 
be used witii a straightforward Fourier transform algorithm to calculate its 

20 corresponding Fourier transform, whereas, according to the second, the measured 
interferogram of each pixel is interpolated to achieve OPD values which are 
equally spaced, and will be used witii a fast Fourier transform algorithm to 
calculate its Fourier transform. Each alternative has advantages and 
disadvantages. Speed is higher m the latter but, as interpolation introduces errors, 

25 reliability of the data is higher in the former. 

Sixth, a complex (real and imaginary) Fourier transform for each pixel is 
calculated by applying the straightforward or fast Fourier transform algorithms to 
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each of the interferograins» depending on alternative choice made und^ the fifth 
step above. 

Seventh, the spectrum of eveiy pixel is calculated as the module (length) of 
the complex function so obtained, a function defined on discrete values of the 

5 conjugate parameter to the OPD, the wavenumber a. 

For further details about the theory of Fourier transformation and the 
mathematical steps for computing the mathematical spectrum as an approximation 
to the real physical spectrum, starting from the measured interferogram, the reader 
is referred to textbooks such as Chamberlain (1979) The principles of 

10 interferometric spectroscopy, John Wiley and Sons, which is incorporated by 
reference as if fully set forth herein. 

In some highlights of chapters 2, 4, 5 and 6 of Chamberlain (1979) the 
following basics of the Fourier transform manipulation and relevant considerations 
are described. The Fourier integral relation between a function f(k) and its Fourier 

15 transform F(x) is shown on page 31. In principle, f(k) and F(x) are continuous 
functions of their variable, but in practice they are always known for discrete 
values, so that the Fourier integral is approximated by an infinite sum as shown on 
page 55. The infinite sum is in turn substituted with a finite sum as shown on page 
57. The perfect and practical mterference functions in the case of electromagnetic 

20 radiation are derived as shown on pages 96 and 104. The relation between the 
physical spectrum and the mathematical spectrum is shown on page 127, and the 
theory of sampling and correction of phase errors are shown in sections 6.7 to 6. 1 1 . 
Finally, the Fast Fourier Transform algorithm is detailed in chapter 10, and is 
shown to operate only when the discrete intervals are all equal, yet this operation is 

25 faster than the straight Fourier summation. 
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It will be appreciated by one ordinarily skilled in the art that the third step 
of the method described hereinabove can be accomplished in many alternative 
ways. One of these alternatives is as follows. 

First, one of the frames is defined as a reference frame. In principle it is not 

5 important which fi^me is selected as the reference. In practice, however, it is 
better to select a frame which is roughly centered with respect to the set of 
translation vectors, so that the overall spatial overlap between the selected frame 
and all the other frames is maximized. Thus selecting the reference frame assists 
in finding the translation vectors for each of the frames measiu*ed. 

10 Second, a subtraction image which is the difference in intensity between a 

first frame and the reference frame is displayed. 

Third, the first frame is moved m small steps to the right-left and up-down 
directions while always displaying the intensity difference, until a position in 
which the displayed subtraction image is substantially zero everywhere, or has 

IS substantially no features, is found. In the ideal case, in which the movement is 
completely rigid, the subtraction image equals zero at all pixels of overiap. In 
practice, however, there will always be a slight pattern, and then the best position 
is the one in which this pattern is minimized in intensity. Experience proved that it 
is quite easy to find the substantially zero position by eye, because a slight lack of 

20 spatial registration emphasizes the differences between two frames, which are 
therefore easy to detect. This procedure can be automated using various known 
algorithms, see for example Anil K. Jain (1989) Fundamentals of digital image 
processing. Prentice-Hall International and system sciences science, pp. 400-402. 
However, due to the presence of fringes superimposed on the frames, it is 

25 preferred that a fringe suppression algorithm is employed prior to automatic spatial 
registration of the fi'ames. 

Fourth, the translation vector for the first frame is recorded. 
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Fifib, the procedure is repeated for all additional frames of the 
measurement. 

And finally, knowing the OPD dependence on position (it is a specific 
dependence for every interferometer), the OPD vector for every pixel in every 
5 frame is calculated and stored. 

Problems which may arise during measurement and which affect the final 
results are mostly associated with the amplitude of the object's movement. For the 
method to be useful, the amplitude of the movement is preferably not too large. In 
particular, a number of possible problems may arise. 
10 First, entire regions of the interferogram maybe missing, making it very 

difficult to interpolate (in the case of interpolation). 

Second, if the central portion of the interferogram is completely missing, 
the Fourier transform cannot be calculated. 

And finally, if due to the movement of the examined object the actual OPD 
15 steps (after correction for the movement) are larger than the Nyquist condition (one 
half the lowest wavelength of sensitivity of the instrument), spurious results may 
be introduced. 

Nevertheless, corrective actions may be undertaken, some of which are 
listed hereinbelow. 

20 First, in a case where the central portion is present, it is usually easy to find 

the center of the interferogram. In this case, if the interferogram is symmetric, data 
points on one side of it can be reflected to the other side, filling holes in the 
process. 

Second, take the smallest OPD steps compatible with the needed spectral 
25 resolution and measurement time. This again will have the tendency of not 
allowing large holes in the interferogram. 
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Third, repeat the interferometn scan two or three times and then join the 
data as if measured in one measuremmt Thus, if an OPD is missing in one of the 
scans, diances are (for random movement) that it will not be missing in another. 
Fourth, in an interferometer in which the OPD in a frame varies in one 
5 direction only (e.g., horizontal), and if the movement of the object is in one 
direction only (e.g., the human eye displays preferentially involuntary horizontal 
movements), make sure the instrument is rotated around the optical axis, so that 
the OPD gradient is peipendicular to the direction of the object movements. This 
way the movements affect only the spatial registration of the frames and the 
1 0 interferograms stay ahnost unaffected, reducing significantly one source for errors. 

Fifth, in the case of a featureless object, it is expected that a movement will 
not affect the results significantly, since ail pixels are equivalent m any case. 

And finally, the following distinctions should be made: (i) an object that 
moves rigidly and lineariy on a plane, i.e., die object moves such that all of its 
15 parts keep theur shape and size, and their relative distances remain constant as seen 
through the spectral imager, and (ii) an object that moves linearly on a plane, such 
that all of its parts keep their shape and size, but the relative distances of the parts 
may vary in time. Obviously, the former case is simpler flian the latter. In 
addition, once an acceptable solution is found for the former, the latter can in 
20 general be solved by segmenting the object into individual areas which may move 
with respect to one another, although each one separately moves rigidly, and then 
applying to the individual areas the solution of the former case. 

It should be noted that the considerations described hereinabove are valid 
for certain type of movements, m particular rigid linear movements (both random 
25 or not). However, it will be evident that some of the considerations described 
hereinabove can be generalized to other types of movements, e.g., non-rigid and/or 
non-linear movements. In any case, a rotation of the object around an axis which 
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is perpendicular to the line of sight of the instrument cannot be addressed in 
principle, because parts of the object will change shape and disappear from view 
during the measurement, and obviously then the measurement will be incomplete. 
As is appreciated by one ordinarily skilled in the art, solving the problem of 

5 the moving object is equivalent to calculating the Fourier transform of an 
interferogram defined for values which are inherently not equally spaced. This 
problem is known m radio astronomy (see. Synthesis Imaging (1986) Perley, 
Schwab and Bridle, Report of Summer School of the National Radio Astronomy 
Observatory, p. 72, Greenbank W. Virginia), where there is clumping of data in the 

10 low OPD range, and this introduces large undulations in unage intensity which 
make it difficult to detect weak point sources. 

Obviously, in the cases of a living tissue, it is generally difficult, if not 
impossible, to keep the analyzed tissue completely motionless. This is due to 
respiration, heart beat, involuntary movements of the patient, etc. Even when the 

15 tissue itself is forced to be stationary by external mechanical means (for example 
special holders to keep an eye stationary during corneal surgery), the mere fact that 
blood is circulating in the vessels induces a small movement in the examined 
tissue. In this case, especially when the object is magnified through a microscope, 
the movement of the analyzed area is also magnified. 

20 An interferometer based spectral imager as taught in U.S. Pat. No. 

5,539,517, combined with the described for spatial registration and spectral 
correction, or in other words compensating both spatially and spectrally for 
movements of the examined object, based on the spectral information that it 
provides, not only may enable noninvasive evaluation of the oxygen saturation 

25 level of hemoglobin in retinal blood vessels and hemoglobin concentration thereat, 
but also, because of the imaging information that it provides, it may be used for the 
detection and mapping of retinal ischemia. Joined to advanced spectral analysis 
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algorithms such as but not limited to principal component or neural network 
algorithms, it may also prove useful for classification of the different retinopathy 
stages, and treatment categorization of for example diabetic patients. 

Many chemicals in the living tissue are related to the functioning of the 
5 vessels and to metabolism. Therefore, even though the primary element for retinal 
ischemia is oxygen, which can be measured through the concentration of 
hemoglobin in the oxy- and deoxy forms, important information can be obtained 
also by measuring the concentration of other constituents, such as NAD+ NADH, 
flavin, cytochromes, oxidases, reductases, etc. 

10 Considering the large amount of prior art that has been described for 

spectral detection of such chemical constituents of tissue, correlating the 
absorption peaks in reflectance, and the fluorescence peaks in UV or blue light, 
single or multiple wavelengths excitation, to their concentrations, it is conceived 
that an interferometer based spectral imager as taught by U.S. Pat. No. 5,539,517, 

15 combined with the described method may be used to map concentrations of one or 
more of such constituents simultaneously in living non-motionless organs/tissues. 
The particular hardware configuration m which the imager will be operated, will 
dictate the type and amount of information obtained. 

For example, the simplest and most straightforward configuration is when 

20 the imager is attached to the CCD port of a fundus camera, so that the retina is 
imaged, and the same wide band white light source of the fundus camera is used to 
measure the reflected light from the retina. In this case oxygen concentrations can 
be measured using Delori's algorithm [Delori (1995) AppL Optics 27:1113-1188, 
and Appl Optics, Vol. 28, 1061; and, Delori et al (1980) Vision Research 

25 20:1099], or sunilar, extended to all pixels of the unaged retina. More complicated 
systems based on interferometer based spectral imagers are: (i) auto-fluorescence 
spectral imaging; (ii) spectral imaging using UV or blue light fluorescence 
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simultaneously, or in succession, at the following wavelengths: 650, 442, 378, 337, 
325, 400, 448, 308, 378, 370, 355, or any other equivalent wavelengths which give 
similar information. 

5 These configurations can be built in several ways, either separately or 

combined in any number of combinations in the same instrument: the instrument is 
made of the lig^t source(s), the fundus camera and the spectral imager, including a 
computer and software to interpret the data and display it in a useful way for the 
ophthalmologist. 

10 In all cases of white light reflection, auto*fluorescence, single wavelength 

continuous wave laser excitation fluorescence, or multiple wavelength laser 
excitation fluorescence, the sample is illuminated and a spectral image is 
measured. 

In the case of pulsed laser illumination, the method of work of the spectral 
15 imager is slightly modified and requires some hardware changes which are not 
basic and substantial, but important for the instrument to operate. These changes 
are the following. 

For single pulsed laser excited fluorescence spectral imaging, the laser 
pulses and the frame grabbing of the CCD of the imager are synchronized with the 

20 scanning angle of the interferometer, so that at each pulse the interferometer 
performs a step, and a new frame is collected by the computer (several pulses can 
also be used in general for each frame, as long as this number does not change 
from frame to frame). In this way, at each OPD value, the interferogram value 
corresponds to the same number of pulses of the laser. This is necessary to ensure 

25 that each frame is taken with the same total illumination intensity, otherwise, each 
fi^e measures the fluorescence resulting from a different nimiber of laser pulses 
and the interferogram will be distorted. 
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For several pulsed lasers induced fluorescence spectral imaging, the method 
of work can be in two ways: (i) collect a whole spectral cube for each laser 
separately as above, in succession; this means that during a measurement only one 
laser is activated, and at the end there is one spectral cube measured for each laser 

5 wavelength; and, (ii) pulse each laser in succession in synchronization with the 
interferometer and the frame grabbing, so that all the lasers are switched in 
succession before the next step of the interferometer and the next frame is taken; in 
this case, at the end, only one spectral cube is measured. 

All the information must be analyzed and interpreted. The most unportant 

10 algorithms are going to be of a type that compares the resulting intensities between 
different wavelengths and between different pfacels of the unage. These algorithms 
should consider variations of intensities, and ratios between different regions in the 
tissue and between difiFerent wavelengths. The method will be very sensitive, and 
may replace slit lamp unaging (white light or filtered light), because it will provide 

15 a large quantitative information. 

Other applications will be apparent to one ordinarily skilled in the art. 
These include visual loss due to choroidal ischemia, acute sectorial choroidal 
ischemia, ischemic optic neuropathy, corneal and iris problems, etc., and many 
others which are analyzed today by imaging techniques, either using white light or 

20 fluorescence of different origins. 

Since the spectral imagers according to U.S. Pat. No. 5,539,517 can be 
attached to any imaging optics including endoscopes and laparoscopes, it may be 
used as an aid to the surgeon before, during or after surgeiy to accurately define 
the diseased tissue to be removed, to aid in the decision where to start cutting, 

25 where to stop, and to judge whether all diseased tissue has been removed during an 
operation procedure. These spectral imagers are intrinsically suitable to analyze 
the nature of the tissue through the chemical composition, related in turn to its 
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spectral characteristics, and to provide a visual map (usually enhanced), for a user 
to grasp, take decisions and act. 

In the case of cancerous tissues detection in vivo, both the hardware 
configurations and the types of analysis and display algorithms involved are very 

5 similar to the above described ophthalmologic examples. The differences are in 
the coUectmg optics (endoscopes of different types instead of for example a fundus 
camera), in the types of some basic molecular components involved in the 
detection: some of these are probably common, such as oxygen concentration, 
additional others are collagen and elastin, genetic material in the cell nuclei, such 

10 as DNA chromatin, etc. The illumination and synchronization requirements in the 
caise of multiple wavelengths or pulsed excitation are similar as well [Pitris ei alj 
Paper presented at European Biomedical Optics Week by SPIE, 12-16 September 
1995, Barcelona Spain]. 

In all these examples spatial registration and spectral correction are required 

15 and are provided by the described method. 

The power of the spatial registration and of the spectral correction method 
is further described and exemplified hereinbelow. 

Spatial Registration and Spectral Correction - the effect on the image: 
Figure 4a presents a spectral image of the optic disk of the retina of a right eye of a 

20 healthy individual using the SPECTRACUBE system, while not employing spatial 
registration and spectral correction procedures as described in accordance with the 
method of the present invention. Figure 4b, on the other hand, presents the very 
same image after spatial registration and spectral correction procedures according 
to the present invention. 

25 In both images the optic disk appears lighter in the middle portion of the 

image along with blood vessels nourishing the optical nerve with o^Q^gen and other 
nutrients (arterioles) and removing waste and carbon dioxide generated during 
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metabolism (veins). However, as is clearly evident comparing the two images, due 
to movements of the eye during measurement, the image of Figure 4a is highly 
blurred Corrective action according to the method of the present invention, in 
which spatial registration and spectral correction were applied, resulted in a much 
5 clearer image as shown in Figure 4b. 

Furthermore, the images presented in Figures 4a and 4b show not only the 
spatial organization of the tissue, as they also present spectral information, 
although not in a direct fashion. In other words, the different colors present in the 
images result from the application of an RGB algorithm to the spectrum of each 

10 pixel of the image such that each pbcel, according to its spectrum and according to 
the preselected RGB fimction is presented by RGB colors in corresponding 
intensities. It is clear that as a result of the distorted spectra associated with pixels 
of the image shown in Figure 4a, as is further demonstrated hereinbelow, the RGB 
function yields different results when applied to either unage. 

15 This Example emphasizes the importance of spatial registration and spectral 

correction to obtain clear and informative image of the examined moving object, 
the eye in the present case. 

The following examples demonstrate specifically the importance of spectral 
correction to obtain meaningful spectral information from selected regions of the 

20 examined object, which information may be employed to achieve information 
about the metabolic condition of an examined tissue, etc. 

Spectral Correction - the effect on the interferogram: Figure 5a presents a 
portion of an interferogram calculated for a single pixel (x = 112, y = 151) of the 
image presented in Figure 4a, i.e., while not employing spatial registration and 

25 spectral correction procedures as described in accordance with the method of the 
present invention. Figure 4b, on the other hand, presents the corresponding portion 
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of an interferogram of the very same pixel after spatial registration and spectral 
correction procedures according to the present invention. 

Examining the interferogram of Figure 4a reveals that the left and central 
parts of the function (measured in equal mtervals of time) resembles a typical 

5 interferogram, whereas the right portion of the function, is totally atypical. The 
local maximum indicated by an arrow is due to sudden motion of the examined 
object (e.g., a saccadic motion of the eye). The uncharacteristic increase of signal 
is due to the fact that a difiFerent point in the object being measured suddenly 
appeared not in its original place, giving a different value for the interferogram 

10 function, as compared with a situation wherein the object remains stationaiy. 

Nevertheless after spatial registration and spectral correction procedures 
according to the present invention are applied, as shown in Figure 5b, the 
interferogram ftmction of the same pixel appears typical. 

As can be seen in Figure 5b, the corrected interferogram is well behaved. It 

15 does not have spurious discontinuities or uncharacteristic portions characterizing 
the non-corrected interferogram of Figure 5a. 

However, the corrected interferogram of Figure 5b is now defined in 
nonuniform intervals. For example one notices that around frame number 107 the 
density of data is low, meaning that the eye moved in a direction opposite to the 

20 scanning direction of the interferometer, increasing the OPD intervals around it, 
whereas around frame number 109.5, which is an artificial frame number formed 
due to the magnitude of movement of the eye in the same direction as the scanning 
direction of the interferometer, die density of data is higher, decreasing the OPD 
intervals around it. 

25 There are therefore, several routes by which one can perform the Fourier 

integral to approximate the physical spectrum of the specific pixel. According to 
one route one can interpolate between the given OPD values and then define a new 
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interferogram having equally spaced OPD values, thus allowing use of a fast 
Fourier transform algorithm to approximate the physical spectrum of that pixel. 
According to another route, one can calculate the Fourier integral as the sum of the 
interferogram values weighted according to tfieir own mtervals using Equation 
5 (16): 

(16) f(o)- l/K-ZF(xi)Aie(i^xi) 

where K is a constant, f(a) is the value of the spectrum at wavelength X = 1/a, and 

10 Ai is the difference between the OPD at xi and the OPD at xj+i. It will be 
apparent to one ordinarily skilled in the art, that there may be additional ways to 
approximate the physical spectrum, such as methods as described in Synthesis 
Imaging (1986) Periey, Schwab and Bridle, Report of Summer School of the 
National Radio Astronomy Observatory, p. 72, Greenbank W. Virginia. 

15 Spectral Correction - the effect on the spectrum: Figure 6a presents 

spectra of five adjacent pixels derived from the image of Figure 4a, while not 
employing spatial registration and spectral correction procedures as described in 
accordance with the method of the present invention. Four of these pixels are 
centered around the fifth which is the pixel whose interferogram is shown in 

20 Figure 5a. Figure 6b, on the other hand, presents spectra of the same five pixels 
after application of the spatial registration and spectral correction procedures 
according to the present invention. The dip around 575 nm is characteristic of 
oxyhemoglobin absorption. 

Comparing the spectra of Figures 6a and 6b, one notices two phenomena. 

25 First, corresponding spectra are much noisier in Figure 6a as compared with Figure 
6b. Second, when implementing the method of the present invention, as shown in 
Figure 6b, from pixel to pixel the spectra change in a uniform pattern presenting 
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an expected smooth behavior over the entire spectral range, whereas none such 
behavior can be seen in the spectra of Figure 6a, 

Thus, these examples emphasize the importance of spectral correction to 
obtain meaningful interferograms and spectra derived from an examined moving 
5 object 

Spatial registration of Frames assisted by Fringe suppression: The raw 
data of a randomly moving object as measured by an interferometric spectral 
imager, should be preprocessed before the Fourier Transform is calculated on the 
pixels interferograms to obtain the best final spectral cube. 

10 This is due to the fact that m a spectral imager based on a Sagnac or similar 

type interferometer as herein described, the instantaneous Optical Path Difference 
(OPD) correspondmg to an interferogram data point depends not only on the 
specific CCD frame but also on the specific pixel to which that data point refers. 
As a result, if the object moves during the measurement, the pixel occupied 

15 by a point on the object is different than if the object is stationary, and if no 
correction is used, the Fourier Transform algorithm uses the wrong OPD for that 
data point The resultant spectral image cube can be significantly corrected if by 
some means the algorithm is made to use the appropriate OPD for each data point 
instead of the inappropriate one. Finding the appropriate OPD for each 

20 interferogram data point requires (i) spatial registration of each acquired frame and 
recording of its registration vector; and (ii) calculation of the actual OPD for each 
data point, based on the registration vectors and on the OPD dependence on 
position. 

However, there is one physical phenomenon, the appearance of fringes, 
25 which makes the frame registration more difficult, yet not impossible, when 
performing this registration automatically. As shown in Figure 7a, fringes are 
straight line stripes of intensity modulation superimposed on the frame, which 
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slightly change position, with respect to the frame on which they appear, 
depending on the scanning position of the interferometer. The origin of the stripes 
is due to constructive (light stripes) and destructive (dark stripes) interference of 
the light rays while passing through the mterferometer, and their shape (vertical or 
horizontal straight lines, depending on optical alignment) is due to the fact that all 
the pixels on a vertical line (or horizontal, respectively) go through the same OPD 
for every scanned frame, so that they undergo the same amount of interference (for 
the same wavelength of light). The change in position from frame to frame is due 
to the fact that the constructive or destructive level of interference for a certain 
pixel changes according to the interferometer position while scanning. The stripes 
are not very bothersome when registering the scanned frames by eye one on top of 
the other, because despite the fringes, the other features (e.g., patterns of blood 
vessels in the eye) are well visible in each frame, and the appearance of the stripes 
does not prevent an observer, when superimposmg one frame over the other, from 
deciding the best spatial registration. 

However, when using an automatic algorithm, these stripes may introduce a 
difficulty, because they represent a nonuniform light intensity change, 
superimposed on the features of the frame. As already mentioned, the fringes are 
vertical (or horizontal) stripes which travel in position from frame to frame in a 
direction perpendicular to the stripes, in unison with the interferometer mirror(s) 
rotation. 

The input of the fringe suppression algorithm is the cube of interferogram 
frames with fringes and the output a cube of frames without fringes, as further 
described hereinbelow. 

Few assumptions are made concerning the operation of the fringes 
suppression algorithm. 
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One assumption is that the fringe "frequency" is approximately known. In 
other words, it is assumed that the distance in pixels between adjacent fringes is 
approximately known. One may gain this knowledge from previous experience on 
a certain type of sample, from each of the frames of the interferogram cubes 
5 themselves, or from a calibration process. 

As seen in Figure 7a, the fringe information is very compactly located in the 
frequency domain. The center frequency of the fringe can be easily found and the 
width of the fringe information in the frequency domain is assumed to be constant 
or nearly constant for all of the scaimed frames. 
10 The fringes suppression algorithm therefore suppresses the fringes by 

artificially zeroing or inteipolatmg out the signal in the frequency range of the 
spatial frequency domain where the fringes information lies, for each scanned 
frame. 

Since the fringes are almost parallel to one of the axes (say x-axis), one can 
15 divide the frame into vectors along the axis that is perpendicular to the fringes (say 
y-axis), each vector set of values being the intensity values of a raw or colunm of 
pixels. Figure 7b shows the intensity values of 200 pixels of such a vector, 
wherein the fringes are clearly evident between the 100th pixel and the 150th pixel 
of this vector. As shown in Figure 7c, each vector is thereafter transformed to the 
20 frequency domain using, for example, the fast Fourier transform algorithm (FFT), 
the peak ranging from ca. 0.15 to ca. 0.35 pixel" 1 contains the fringe information. 
As shown in Figure 7d, for each vector the frequency region where the fringe 
information is located is zeroed, and, as shown in Figure 7e, transformed back to 
the spatial domain using, for example, inverse fast Fourier transform algorithm 
25 (IFFT). This procedure is performed for each of the vectors of every frame 
grabbed by the spectral imager while scanning the interferometer and results in a 
fringes suppressed frame, as shown in Figure 7f 
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Should for some reason the fringes be offset angularly, i.e., not arranged in 
exact vertical or horizontal direction, a small decrease in the frequency of the 
fringe information band will result This problem can be solved by increasing the 
width of the region of zeroing or interpolation of the signal in the spatial 
5 frequency domain where the fringe information lies. 

As is evident from Figure 7c, most of the frame^s energy is located in the 
lower bands in the frequency domain. Using a band-stop filter not only preserves 
the information m each scanned frame but also doesn't blur the frame since the 
energy in the higher bands is not attenuated, and the edge information is preserved. 
10 It will be appreciated by one ordmarily skilled in the art that using the 

Hough transform [Paul V. C. Hough, "Methods and means for recognizing 
complex patterns"; and U.S. Pat No, 3,069,654, both are incorporated by reference 
as if fiilly set forth herein], one can extract the frequency position of the frmge 
infomiation and use it for the fringe suppression algorithm. The Hough transfonn 
15 can also find the orientation of those fringes and make the necessary adjustments. 

To keep the signal real after the IFFT, the zeroing procedure is performed 
preferably symmetrically relative to the origin of the spatial frequency axis (Even 
though not shown in the Figure, the signal in the frequency domain is defined for 
both positive and negative values of die frequency f, and it is an even or 
20 symmetric function of 0- The signal after the IFFT, as shown in Figure 7e, has a 
very small imaginary residual part that is eliminated using the absolute (or the real) 
part of the result. 

Returning to Figures 7b and 7e, instead of executing the FFT, zeroing and 
IFFT procedures as hereinabove described, one can simply interpolate the plot of 
25 Figure 7b through the fiinges region, intersectmg each of the fringes intensity 
peaks substantially at their central relative intensity to obtain an interpolated plot. 
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as indicated by I (for intersecting) in Figure 7b, which is otherwise very similar to 
that shown in Figure 7e. 

An additional option is, for the region where the fringes information lies in 
the spatial frequency domain, instead of zeroing the peak (as shown in Figure 7e), 
5 draw a straight line interpolation between the edge pomts of the peak. 

The preferred fringe suppression algorithm according to the present 
invention is hereinbelow described in mathematical terms. 

Let X(x,y) be the input frame (as, for example, shown in Figure 7a), Y(x,y) 
the corresponding output frame (as, for example, shown in Figure 7a), x and y are 
10 the discrete coordinates of a pixel m the frame, (cF center frequency of the 
fringe mformation, (lF *e low frequency of the fringe information, fnp high 
frequency of the fringe information, A( the width of the fringe suppression band 
and m( 0 a step function. 

By definition: 

15 fLF=fCF-0-5Af (17) 

fHF- fCF + 0-5A((i8) 

A "zeroing band'' function is defined as: 

20 W(0={l-[w(f- fLF)-Kf- fHF)] fLF)-«(f+ (HF)]} (19) 

W(/) (the "zeroing band" function) is defined as a function of the firequency/such 
that, when multiplied by another function of the frequency y; it leaves it unaltered 
for values of/ lower than^LF and higher than fyjp , and changes it to zero for 
25 values of /higher than and lower than^fB? • 

The output frame without fringes can then be expressed as: 
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Y(x,y) = Re{IFFT{W(0*FFT{X(:,y)}}} (20) 

Using the fringe suppressed frames will assist in automatic registration 
procedures, which otherwise may face difficulties due to the repetitive pattern of 
the fringes superimposed on the frames. 

EXAMPLE 4 

SPECTRAL IMAGING OF SELECTED EYE TISSUES 
The method described and exemplified under Example 3 above was 
employed to obtain spectral images of eye tissue of healthy and diseased patients 
as described in the following examples. It should, however, be noted that 
mechanical and chemical methods for eye fixation are well known in the art and 
are extensively employed during, for example, invasive eye procedures, such as 
laser operations. Such methods may also be employed for spectrally imaging eye 
tissues according to the present invention. Furthermore, as mentioned above, 
should the spectral imager of choice be a non-interferometer based imager (e.g., a 
filters based spectral imager), only conventional spatial registration is required for 
analyzing the eye. In addition eye tracking methods may be employed. Such 
methods are used in laser operations to track eye movement. 

In the following, reflection of visible light illuminated via the iris was 
employed for spectrally analyzmg eye tissues of healthy and diseased patients. 
Illumination was with white light and all the spectral data collected was between 
500 and 620 nm. This is the region of hemoglobin absorption, which is the most 
prominent spectral feature of the retina. This spectral region, however, contains 
also the long wavelength tails of other absorbing structures: the eye media, the 
macular pigment and the melanin [Van Norren and L. F. Tiemeijer, Spectral 

26 No. 2, pp. 313-320, 1986]. 
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The spectral variation of the specific extinction coefficients of oxygenated 
(Hb02) and deoxygenated (Hb) hemoglobin are shown in Figure 9 [see also Delori 
F. C, Noninvasive technique for oximetry of blood in retinal vessels, Applied 
Optics Vol. 27, pp. 1113-1125, 1988, taken from O.W. van Assendelft, 

5 Spectrophotometry of Hemoglobin Derivatives, C.C. Thomas, Springfield, IL, 
1970]. Hb02 presents two peaks, at 540 and 578 nm, while Hb presents only one 
peak, at 558 irai. As is well known fix)m the prior art [see for example, Delori F. 
C, Pfilbsen K.P., Spectral reflectance of the human ocular fundus, Applied Optics 
Vol. 28, pp. 1061-1077, 1989], peaks in the extinction coefficient mean dips in the 

10 reflectance spectrum. Delori Pelori F; C, Noninvasive technique for oximetry of 
blood in retinal vessels. Applied Optics Vol. 27, pp. 1113-1125, 1988] has shown 
how reflectance measurements of retinal vessels can be used to measure oxygen 
saturation (02Sat) and vessel diameter. Delori's work pioneered this field, but it 
was only related to vessels of the retina, and it had no imaging capability. As a 

15 resuh Delori did not present spatial maps of 02Sat over the whole retina, and did 
not map the different regions of the ocular fundus, such as macula, disk, etc. on 
the basis of spectral information. 

In this work the model presented by Shonat [Ross D. Shonat, Elliot S. 
Wachman, Wen-hua Niu, Alan P. Koretsky and Daniel Parkas, Simultaneous 

20 hemoglobin saturation and oxygen tension maps in mouse brain using an AOTF 
microscope. Biophysical Journal (1997), in press] was extended to fit the spectra 
of all retinal regions so that the data of a whole spectral image can be used to map 
various features, such as, but not limited to, vessels, 02Sat, optical density of total 
hemoglobin, spectral differentiation between healthy, intermediate and degenerate 

25 macular tissue, spectral differentiation between healthy and glaucomatous optic 
disks and cups, etc. 
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A Modeling the retina 

Figures 8a-b show spectral images of a retina obtained using the 
SPECTRACUBE spectral imager. The color presented by each pixel in the unages 
is determined by an RGB algorithm as described under Example 2 above. The 
weighting functions were (= 570-620 nm), Wg( 530-570 nm) and = 500- 
530 nm) mimickmg full transmission in the selected ranges and no transmission 
outside the selected ranges. 

Figure 10 shows the inverted log of reflectivity spectra (proportional to 
extinction coefficient), as measured by the SPECTRACUBE system, of one pixel 
of a vein and one of an artery. It is seen that the peaks m the vein are less 
pronounced than in the artery, as expected from the known oxygenated and 
deoxygenated hemoglobin extinction spectra shown in Figure 9. 

Figure 1 1 shows spectra of pixels from the disk, the cup, the retina, and 
from a retinal blood vessel. The spectral resolution of this measurement is low, 
approximately 20 nm, and this is the reason for the shallowness of the dips seen. It 
is well known in the literature [for example, Patrick J. Saine and Marshall E. Tyler, 
Ophthalmic Photography, A textbook of retinal photography, angiography, and 
electronic imaging, Butterworth-Heinemann, Copyright 1997, ISBN 0-7506-9793- 
8, p. 72] that blue light is mostly reflected by the outer layers of die retinal tissue, 
while as the wavelength increases, the light is reflected by deeper and deeper 
layers. 

Figure 12 is a schematic diagram of the reflection of different wavelengths 
from different retinal depths. This means that monochromatic images show 
features characteristic of different depths. 

Different models, such as, for example, the well known 02Sat model used 
by Delori for retinal vessels, and by Shonat et a/., on the surface of rat brain, 
Pelori F. C, Nonmvasive technique for oximetry of blood in retinal vessels. 
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Applied Optics Vol. 27, pp. 1113-1125, 1988, and Ross D. Shonat, Elliot S. 
Wachman, Wen-hua Niu, Alan P. Koretsl^ and Daniel Farkas, Simultaneous 
hemoglobin saturation and oxygen tmsion maps in mouse brain using an AOTF 
microscope. Biophysical Journal (1997), in press, both are incorporated by 

5 reference as if fully set forth herein ], and modifications thereof, might be used to 
fit the spectral data in each pixel of the image separately to explain the results. 

Such models, if successful, might predict the presence, absence or amount 
of physiologically important metabolites, such as, but not limited to, hemoglobin, 
cytochromes, oxidases, reductases, NAD, NADH and flavins, pixel by pixel, and, 

10 once displayed in a spatially organized way, may be the basis for highlighting 
regions of impaired tissue "vitality" or "viability". 

Figures 13a-c shows spectra, extracted from several pixels of a spectral 
image measured with the SPECTOAGUBE system, belonging to different 
anatomic regions of the retina (Figures 13b-c) as compared to spectra measured 

15 and published by Delori (Figure 13a). Figure 13a presents spectra described by 
Delori derived from the retina, perifovea and the fovea using point spectroscopy. 
Figures 13b-c presents spectra measured using the SPECTRACUBE system of the 
same tissues (Figure 13b) and of a retinal arteiy, retinal vein and a choroidal blood 
vessel (Figure 13c). Comparing Figures 13a and 13b, the similarity of the results 

20 is evident, although there are also some differences, which may be due to patient 
variability. 

Figure 13c shows the spectra of a retinal artery and a retinal vein and of a 
choroidal blood vessel. The peak at 560 nm is more pronounced in the artery and 
the choroidal vessel than in the vein, as expected from higher oxygenation of 
25 hemoglobin thereat. 
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Figures 14a-e show a portion of retina including retinal blood vessels from 
a healthy individual. Figure 14a shows an RGB image of the retina, wherein 
W|<570-620 nmX Wg(530-570 nm) and wi,(500-530 nm). 

Figure 14b shows an enhanced RGB image of the retina. The intensities of 

5 the three colors, red, green and blue, i.e., RGB, are related algebraically to the 
nimnalized intensities in the three spectral bands Bl, B2 and B3, defined as 
follows Bl = 525-590 nm, B2 = 600-620 nm and B3 = 500-650 nm. In each of 
these bands the integral intensity was calculated for each pixel. The intensity was 
dien scaled so that the minimum value over the whole image was zero and the 

10 maximum value was one. The red intensity was then given by: R = B2/(l + Bl); 
the green intensity was given by: G B3; whereas the blue intensity was given by 
B = (1 + Bl - B2)/(l + Bl). The latter RGB algorithm was employed to 
specifically enhance the spectral difference between retinal veins (dark red) and 
arteries (light red). Thus, using the present invention it is possible to strongly 

15 enhance metabolic characteristics of the retina and retinal blood vessels. 

Figures 14c and 14d are gray level images wherein for each pixel light of 
the specified wavelengths (610 and 564 nm, respectively) is given a gray level 
according to its intensity. Please note that only the vein is highlighted at 610 nm, 
whereas both arteries and the vein are highlighted at 564 nm. Thus, images at 

20 different wavelengths are shown to highlight different aspects of the retinal 
pl^siology. 

Figure 14e is a hemoglobin oxygenation map for the retinal blood vessels. 
The map of Figure 14e was calculated using, for each pixel, the algorithm for 
02Sat developed by Shonat [Ross D. Shonat, Elliot S. Wachman, Wen-hua Niu, 
25 Alan P. Koretsky and Daniel Farkas, Simultaneous hemoglobin saturation and 
o^gen tension maps m mouse bram using an AOTF microscope, Biophysical 
Journal (1997), in press]. 
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Deoxygenated blood has a higher extinction coefficient in the red 
wavelengths than oxygenated blood (Figure 9), and therefore veins look slightly 
darker and with a slightly different color than arteries, because they carry blood at 
different levels of oxygenation (see Figure 14a). However, the color difference is 
very small and in a conventional color image of the fimdus, it can be hard to 
distinguish between them, except, in some cases, for the largest vessels. 
Oxygenation mapping or simple enhancing artificial RGB mapping based on 
spectral features m^ be a tool that significantly enhances the distmction between 
the different type of vessels. 

Figure 15 shows spectra derived from a hemorrhage and healthy retinal 
regions of a patient suffering from diabetic retinopathy. Please note that the 
spectra of the affected retinal region is much flatter, probably due to lower levels 
of oxygenated hemoglobm than the one present in healthy retina. 

b. Modeling the macula 

Inverted log spectra of the macula have been shown by Brindley et al: [G.S. 
Brindley and E.N. Willmer, The reflexion of light from the macular and peripheral 
fundus oculi in man, Journal of Physiology Vol. 116, pp. 350-356, 1952]. Spectral 
reflectance of the fovea and the log reflectance difference of the normal peripheiy 
and fovea are shown by Van Norren et al. p/an Norren and L. F. Tiemeijer, 
Spectral reflectance of the human eye. Vision Res., Vol. 26 No. 2, pp. 313-320, 
1986]. 

Figure 16 shows the inverted log reflectivity spectra of normal, intermediate 
and degenerate macular tissue of a single patient suffering macular degeneration. 
The spectra for the macular tissue represents average of twenty five pixels per 
region. The spectrum of the degenerated macula was divided by a factor of four as 
indicated by ''x4". It is clearly evident that the spectral signature of the normal, 
interaiediate and degenerated macular tissue are defmitely different from one 
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another. Please note that a gradual spectral change towaid degeneration spectral 
signature is apparent in the intermediate tissue. The gradual spectral change from 
normal to diseased tissue may be used for early detection of the disease and for 
foUowing disease progression. 
5 Figure 17 shows a region in the macula of the above patient ranging from 

normal (dark) to degenerate (light). The algorithm employed to enhance the 
spectral signatures of the macular regions was an RGB algorithm where W;<570- 
620 nm), Wg(530-570 nm) and wi(500-530 nm) weighting functions were selected. 
Please note that while normal macular tissue absorbs most of the illuminated light 

10 (i.e., reflects a small fraction thereof) and therefore appears dark, degenerated 
macular tissue reflects most of the Ught (i.e., absorbs a small fraction thereof) and 
therefore appears light. This result is in good agreement with the presence of 
cones and rods in normal macula and their absence from degenerated macula, since 
the rods and cones are, by nature, excellent light absorbers. 

IS c Modeling the optic disk 

Because of the great importance of the optic disk physiology in the 
diagnosis of glaucoma, results of the analysis of the spectral images as they pertain 
to this region of the ocular fundus are presented. 

Figures 18a-d show the optic disk of a healthy individual. Figure 14a 

20 shows an RGB image of the disk, wherein W;<570-620 nm). Wg(530-570 nm) and 
^6(500-530 nm). Figures 18b and 18c are gray level images wherein for each 
pixel light of the specified wavelaigths (610 and 564 nm, respectively) is given a 
gray level according to its intensity. Figure 18d is a hemoglobin concentration 
map of the disk blood vessels. The map of Figure 18d was calculated using, for 

25 each pixel, an algorithm similar to that used for Hb concentration by Shonat [Ross 
D. Shonat, Elliot S. Wachman, Wen-hua Niu, Alan P. Koretsky and Daniel Farkas, 
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Simiiltaneous hemoglobin saturation and oi^gen tension maps in mouse brain 
using an AOTF microscope. Biophysical Journal (1997), in press]* 

Figures 19a-e show the optic disk of a glaucoma suspect Figure 19e is an 
image key, schematically presenting the location of the optic disk and cup in 

5 Figures 19a-d. Figure 19a shows an RGB image of the disk, wherein W;<570-620 
nm), Wg(530-570 nm) and wft(500-530 nm). Figures 19b and 19c are gray level 
images wherein for each pixel light of the specified wavelengths (610 and 564 nm, 
respectively) is given a gray level according to its intensity. Figure 19d is a 
hemoglobin concentration map of the disk blood vessels. The map of Figure 19d 

10 was calculated using, for each pixel, an algorithm for Hb concentration similar to 
that used by Shonat [Ross D. Shonat, Elliot S. Wachman, Wen-hua Niu, Alan P. 
Koretsky and Daniel Farkas, Simultaneous hemoglobin saturation and oxygen 
tension maps in mouse brain using an AOTF microscope. Biophysical Journal 
(1997), in press]. The plots under and to the right of Figure 19d represent the 

15 hemoglobin concentration along the horizontal and vertical lines crossing Figure 
19d. 

Please note that a striking difference in hemoglobin concentration is clearly 
evident comparing the images of the healthy individual (Figure 18d) and the 
glaucoma patient (Figure 19d). 

20 

EXAMPLE 5 

SPECTRALLY IMAGING CHOROIDAL VESSELS AND OTHER 
FEATURES IN THE CHOROIDAL LAYER OF THE EYE 
U.S. Pat. application No. 08/942,122 describes the use and the advantages 
25 of spectral imaging systems for mapping and measuring anatomic and physiologic 
features of the ocular fundus. Examples of hemoglobin and oxygen saturation 
maps, nerve fiber layer mapping, choroidal vessels imaging, macula, fovea and 
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macular degeneration m^s, etc., are described therein and hereinabove and shown 
to be distinguished by different spectra. 

In the present example it is shown how to obtain enhanced images of the 
choroidal vessels and choroidal layer from spectral images measured with the 
SPECTRACUBE and in this respect also other high throughput spectral imagers. 

Figure 20 shows a typical color image of a healthy retina. The image was 
obtained by first measuring the retina as described in U.S. Pat application No. 
08/942,122, including the interferogram corrections and spatial registration 
described in PCT/US97/08153, which is incorporated by reference as if folly set 
forth herein, and then displaying its RGB (Red, Green and Blue) image according 
to the method described in U.S. Pat. No. 5,784,162, namely calculating a 
tristimulus vector for every pixel of the image on the basis of the spectral image 
measured by means of the SPECTRACUBE system and then displaying the result 
in color. This hnage is veiy shnilar to a usual digital color image as obtamed 
through a standard fondus camera. 

It is easy to recognize in this image the dark macular region, the bright optic 
disk, various superficial vessels, and, in the background, a quite unclear and fiizzy 
set of vessels, which are recognized to be choroidal vessels. 

According to this aspect of the present invention the spectral data thus 
collected is used to provide an image in which the choroidal vessels are mostly 
emphasized and brought out of the background in a quite sharp and clear way, 
never realized before, using only reflected white light. 

Once this is obtained one can also present images in which the relatively 
sharp contrast choroidal vessels are shown superimposed on the superficial vessels 
and the rest of the retina. 

Such superimposed images have the potential to be most usefol for 
assessing the vitality, metabolic and pathologic state of the choroidal layer. 



WO00/67d35 



PCT/IL0(l/00255 



86 

For tfiis purpose, first consider the spectra shown m Figure 21. These are 
typical spectra as measured by the SPECTRACUBE, of pixels which are located 
respectively on a choroidal vessel (C), on a superficial vein (V), a superficial artery 
(A) and a region of tissue between these vessels (R). It can be seen that in the 

5 wavelength region of 500 to 600 nm, the spectra of C and R regions are very close 
to each other, while V and A are different than all the others. At about S8S nm the 
spectrum of R starts to deviate from C and approaches the spectrum of A, while at 
about 620 nm V starts to approach A; at about 640 nm and above, the spectra of R, 
V and A are ahnost identical while veiy different from C. The data above 650 nm 

10 are not reliable, because the measurement was made through a red free filter with a 
cutoff at approximately 650 nm. 

In order to show that the results between 600 and 650 nm are not an artifact 
due to the signal suppression by the cutoff filter around and above 600 nm, the 
above spectra were normalized by dividing them, wavelength by wavelength, by 

15 the illumination spectrum which is represented by the "white target spectrum 
shown in Figure 21. This is the spectrum as measured through the instrument of a 
white reflector (which is highly uniform over all wavelengths), and is basically 
proportional to the light source spectrum multiplied by the transmission spectrum 
of the green filter, the transmission of the instrument optics and the spectral 

20 response of the detector. The negative logarithm of that ratio is shown in Figure 3 
for all the spectra C, V, A and R. Because of this normalization, the spectra shown 
in Figure 3 are independent of instrumentation parameters. 

In order to show this more exactly, one can define Fe(X) as the spectrum of 
the radiation reflected by a retinal feature, p(X) as the spectral reflectivity of the 

25 retinal feature, F(X) as the spectrum of a retinal feature (shown in Figure 21) as 
measured, as the spectrum of the illumination source as reflected by the 
^'white target", R(X) as the illumination spectrum as measured (shown in Figure 
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21), K(X) as the spectral response of the SPECTRACUBE including the optical 
transmission, the ffeen filter spectral transmission and the detector response, and 
Fn(X) as the inverse logarithm of the normalized spectrum of a retinal feature 
(from Figure 22). 

The following relations then take place: 

F(X)=Fe(X)xK(X) (21) 
Fe(X)=p(X)xRe(X) (22) 
R(X)=Re(X)xK(X) (23) 
Fn(X)=.log[F(X)/R(X)] (24) 

It follows fi-om Equations 21 and 22 that: 

F(X)=p(X)xRe(X)xK(X) (25) 
and from Equations 23-25 it follows that: 

Fn(X)= - log[p(X) X Re(X) x K{\)/R^{X) x K(X)]= - log [p(X)] (26) 

The resulting spectra calculated according to Equation 26 for the 
different retinal features, are displayed in Figure 22, and obviously the right hand 
side of Equation 26 shows that these spectra are independent of the illumination 
and instrumentation used for the measurement, since p(X) is a characteristic of the 
retinal feature in question. 

It is seen that the behavior shown in Figure 21 holds here too, namely that C 
and R are approximately identical between 500 and 585 nm and different from A 
and V, while above 620 nm V, A and R are very close to each other, while 
different than C. 

As a resuk of this spectral behavior it can be easily understood that a gray 
scale (level) image at a wavelength or in a wavelength range near 550 nm will 
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show a large contrast between superficial veins, arteries and retinal tissue (dark 
vessels in a bright retinal background) with no contrast between choroidal vessels 
and retinal tissue, while a gray scale image at a wavelength or in a wavelength 
range around 650 nm will show high contrast of bright choroidal vessels on a 

5 darker retinal background and almost no contrast between superficial vessels 
themselves and between them and retinal tissue. Figures 23 and 24 show this 
behavior respectively. 

Figure 25, in turn, shows superposition of the choroidal vessels analyzed as 
described over the image of Figure 20 obtained by an RGB display using the 

10 spectral ranges red - 578-650 nm, green - 542-578 nm and blue - 500-542 nm. 

The following lists potential applications of this aspect of the present 
invention. Although not exhaustive, the following list, togeAer with the 
mentioned references, will clarify and exemplify the type of medical utility this 
aspect of the present invention is meant for. In any case, it is recognized that the 

15 method disclosed herein may help in more timely and accurate diagnosis, more 
effective treatment, and treatment follow up, by basically replacmg the ICG 
angiography method for the analysis of choroidal vessels and similar and/or related 
features and pathologies of the ocular fundus. The cited references also give an 
idea of the types of methods and modalities which are used or researched at present 

20 for the study and diagnosis of the relevant diseases and pathologic conditions. 

1. Retinal pigment epithelium (RPE) detachments, see for example 
Disparity between fundus camera and scanning laser ophthalmoscope Indocyanine 
green imaging of retinal pigment epithelidetachments, by Flower R W a/.. 
Retina. 1998; 18(3): 260-268. 

25 2. Choroidal and ciliary body melanomas, see for example The 

microcirculation of choroidal and ciliary body melanomas, by Folberg R et aL, 
Eye. 1997; 1 1( Pt 2): 227-238. Review, Imaging the microvasculature of choroidal 
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melanomas with confocal Indocyanine green scanning laser ophthalmoscopy. By 
Mueller Aiet al.. Arch Ophthalmol. 1998 Jan; 1 16(1): 31-39 

3. Choroidal neovascularization in age-related macular degeneration, 
exudative maculopathy due to age-related macular degeneration, and mtrinsic 

5 tumor vasculature of choroidal malignant melanomas, see for example ICG 
videoangiography of occult choroidal neovascularization in age-related macular 
degeneration, by Atmaca L S e/ aL, Acta Ophthahnol Scand. 1997 Feb; 75(1): 44- 
47, Classification of choroidal neovascularization by digital Indocyanine green 
videoangiography. Ophthataiology, by Guyer D R er a/., Ophthabnology, 1996 
10 Dec; 103(12): 2054-2060, and Indocyanine green videoangiography of malignant 
melanomas of the choroid using the scanning laser ophthalmoscope, by Schneider 
U et aL, Ger J Ophthalmol. 1996 Jan; 5(1): 6-1 1, 

4. Sub-retinal structures, central serous chorioretinopathy, 
photophysiology and treatment of diseases affecting the retinal pigment epithelium 

15 and Bruch's membrane, such as age-related macular degeneration, see, for 
example, Infrared imaging of central serous chorioretinopathy: a follow-up study, 
by Remky A et aL, Acta Ophthahnol Scand. 1998 Jun; 76(3): 339-342, Infrared 
imaging of sub-retinal structures in the human ocular fundus, by Eisner A E e/ a/.. 
Vision Res. 1996 Jan; 36(1): 191-205, Imaging of chorioretinal anastomoses in 

20 vascularized retinal pigment epithelium detachments, by Kuhn D et al.. Arch 
Ophthalmol. 1995 Nov; 113(11): 1392-1398. 

5. Retinal hemorrhages, retinal circulation and late leakage sites, 
choroidal circulation, posterior uveal tumors abnormal vessels in such tumors, see 
Indocyanine green angiography in retinal hemorrhage of uncertain origin, by 

25 Schneider U et aL, Kim Monatsbl Augenheilkd. 1995 Dec; 207(6): 372-376, The 
value of medical imaging techniques in the diagnosis of extra-ocular extension of 
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malign melanoma of the choroid: a case report, by Sallet G et al.^ Bull Soc Beige 
Ophtabnol. 1993; 248: 53-58. 

All of the above references are incorporated by refermce as if fully set forth 

herein. 

5 

EXAMPLE 6 

NON-INVASIVE OPHTHALMIC ANGIOGRAPHY BY SPECTRAL 

IMAGING 

In today's medical practice, the major source of contrast in retinal 
10 angiographic images is the fluorescent emission from either fluorescein sodium or 
indocyanine green dye which attach as molecules to blood plasma proteins 
(albumins in particular). Fluorescein sodium is absorbed by hemoglobin as well. 
In this way, retinal angiography allows the ophthalmologist to study the entire 
vasculature, not just the major arteries and veins withm the retina or choroid, as the 
15 dye perfuses through the smaller vessels and capillaries. 

In contrast, this example of the present invention relies on the spectrally 
dependent absorption of intrinsic hemoglobin. This acts as the source of contrast 
within the spectral image of the retina providing the same visualization of the 
entire vasculature, in the absence of any dye being injected into the circulatory 
20 system of the patient. 

The theoretical basis for the following hemoglobin concentration based 
contrast enhancement algorithm is as follows. 

A simple model to describe the spectrum obtained by reflection of white 
light from the retina is based on the assumption that the spectrum 1(A) (Equation 
25 27) is made up of a signal transmitted through a partially absorbing layer (retina or 
blood vessel) and reflected off a white substrate (sclera). The reverse optical path, 
i.e., reflected off the sclera to then traverse the partially absorbing layer is of 
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course equivalent. This signal is multiplied by the "white calibrator" function W(X) 
which contains the spectral characteristics of the system response, i.e., light source, 
detector sensitivity etc. 

I{X)^W{X)l^e'^^>''^ (27) 

In Equation 27, tiie term fi(X) represents a generic spectrally dependent 
absorption coefficient of all the intervening pigments in layer of thickness / 
between the surface of the retina and tiie sclera. In the spectral bandpass between 
500 to 650 nm, fi(X) is dominated by oxyhemoglobin and deoxyhemoglobm. 

An additional source of attenuation is scattering, however it is assumed that 
the scattering parameter S is wavelengtii independent. Given this simple model 
one is in search of a data reduction procedure which will "distill" the data, so as to 
reduce effects related to intensity variations and enhance spatial contrast between 
regions differing spectrally as a result of differing concentrations of hemoglobin. 

Define the white calibrated reflectance specter R(X) by tiie following 
relation (Equation 28): 

where W^W is the white target spectrum, i.e., the measured spectrum from a 
white target placed in the position of the patient's eye. The white normalized 
differential IndW, may then be defined as follows (Equation 29): 

■R-\X) (29) 



dR{X) 
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It is straight forward to show that for the model described by Equation 27 
above, assuming W(X) = Wyf^(x) , the white normalized differential IndW yields 
(Equation 30): 



UA- '^'^'^C'^ --m (30) 



The significance of Equation 30 above is that the white normalized 
differential is proportional to the thickness (or concentration) of the absorbing 
medium multiplied by the derivative of the absorption spectrum of the absorbing 

to medium m'W- Since both oxy- and deoxyhemoglobin have strongly modulated 
absorption spectra in the spectml regime of interest compared with virtually all 
other pigment species to be found in the ocular fundus, these two species act as the 
major sources of contrast m the image. 

In order to create an image, the absolute value of IndW summed over the 

IS wavelength A from each pixel, i.e., the intensity at pixel x,y in the angiogram 
image is calculated as follows (Equation 31): 

^^=iM^)| (31) 

The spectral boimds X2 and \\ over which the sum is carried out may be 
varied in order to emphasize oxy- over deoxyhemoglobin or to select a spectral 
20 range in which other pigments in the fundus dominate. Further processing tools 
may also be used in order to eliminate periodic artifacts in the image related to the 
acquisition process. 

Figure 26 shows a retinal angiographic image of an optical disc and 
surrounding retinal tissue of a healthy individual in which blood vessels are 
25 contrasted due to injection of indocyanine green dye to the examined individual, 
whereas Figure 27 shows a retinal angiographic image of an optical disc and 
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surrounding retinal tissue of another healthy individual in which blood vessels are 
contrasted non-invasively using the absorption of intrinsic hemoglobin using the 
algorithm described herem. It is clearly evident that the latter image includes more 
information relating to the distribution of blood vessels within the examined retina 

5 and that the contrast achieved using the algorithm herem described is higher. 

Similarly, Figure 28 shows a retinal angiographic image of an optical disc 
and surrounding retinal tissue of a patient suffering from age related macular 
degeneration in which blood vessels are contrasted due to injection of indocyanine 
green dye to the exammed mdividual, whereas. Figure 29 shows a retinal 

10 angiographic image of the same patient in which blood vessels are contrasted non- 
invasively using the absorption of intrinsic hemoglobin according to the present 
invention. It is clearly evident that the latter image includes all the information 
relating to the distribution of blood vessels within the exammed retina, yet 
achieved non-invasively. 

15 The above demonstrates the efficiency of the spectrally resolved images 

using the algorithm herein described which are comparable and superior to 
conventional ICG images, yet is performed non-invasively. 

The spectral data analysis algorithm according to this aspect of the present 
invention is improved, in that it allows additional choroidal vessels to appear on 

20 the final image that were not brought forth before, using the procedures described 
hereinabove with respect to other embodiments of the invention. 

The spectral data analysis algorithm according to this aspect of the present 
invention is unproved, in that it presents a sharper image and therefore it is a more 
meaningful tool for the eye of the ophthalmologist. 

25 The spectral data analysis algorithm according to this aspect of the present 

invention is improved, in that it is faster and simpler, because it alone allows the 
simultaneous display of the retinal and choroidal vessels superimposed on the 
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same image, just as in the composite images described above in which an 
algorithm brings forth separately the retinal and choroidal vessels, and then an 
additional computational step must be performed in order to display the 
superimposed images. 

5 

EXAMPLE? 
OXYGEN SATURATION MAPPING OF A TISSUE 

One of the objects of the present invention is to provide an efficient optical 
imaging method to map the oxygen saturation state of a blood column in a tissue 
10 and in a blood vessel, in vivo. This method is suitable, in particular, for mapping 
the oxygen saturation in tissue and blood vessels of the ocular fundus, both in 
arteries and veins. This method, like the methods disclosed in the former 
examples, is based on spectral imaging combined with suitable data analysis 
algorithms. 

15 The difficulty in implementing a method of mapping the oxygen saturation 

state of a blood column in, for example, a blood vessel, lies in the fact that for 
most applications, e.g., in the ocular fundus of a living human being, the blood 
vessels are embedded m a multilayer tissue structure and do not exist as stand 
alone objects, to be analyzed. 

20 A spectral image cube or any other spectral data derived from the ocular 

fimdxis measured by reflected white light in vivo carries information on all the 
layers of which the fundus is composed. Thus, such spectral data carries 
information pertaining, for example, to the nerve fiber layer, the retinal pigment 
epithelium and to the choroid. In spectral images of the ocular fundus a clear 

25 vascular network that consists of the retinal vessels is observed on top of another 
network that consists of the choroidal vessels. Thus, there is a need for a tool or a 
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method of extracting the spectral imaging information related only to the vessels 
under study. 

It is evident that a method of mapping the oxygen saturation state of a blood 
column will find uses not only for eye inspection, but m numerous other 

5 applications in which there is a need to measure the spatial and spectral optical 
density map of an object which is located on top, behind or sandwiched between a 
number of other objects of different optical density, and the measurement is 
performed (similarly to the ocular fundus) from a direction nearly perpendicular to 
the planes of the layer structure. The reason is that in all such cases the incident 

10 light rays used for illumination go through all the layers of the structure, and are 
partly reflected, partly scattered, before they reach the spectral imaging sensor. 

The ability to extract the absorption spectrum or optical density of a given 
object (or layer) from the spectrum of the multilayer structure, inside which it is 
embedded, is important when attempting to analyze specific material or 

15 composition properties of this object The case of the blood hemoglobin saturation 
within the ocular fundus provides a particularly interesting and useful example, 
because it is related to the health and viability of the surrounding tissue. Within 
the ocular fundus the blood flows in different rates and directions within two 
different tissue layers, the retina and the choroid, that are spatially organized on 

20 top of each other and are related to the metabolism of two different metabolic 
states of the human eye. The oxygen saturation state of different arteries and veins 
of the retinal tissue is a clear indicator of its viability, as well as a possible 
indicator of certain pathologies. As further explained and exemplified hereunder, 
the present invention enables mapping of the oxygen saturation in retinal vessels in 

25 any chosen region of a digital fundus image, with a spatial resolution which is 
limited by the signal to noise ratio achieved in each analyzed region. 
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Oxygen saturation measurements of the retinal vessels have been carried out 
in the past, but mostly in small regions near or across a vessel separately. One 
exception is a 4-wavelength ima^g method by a Company named Optical 
Insights (see JM Beach, JS Tiedeman, M Hopkins, Y Sabharwal, (1999) "Multi- 
5 spectral fundus imaging for early detection of diabetic retinopathy", SPlE 
Proceedings, Vol. 3603; however, the fundamental lunitation of the Optical 
Insights instrument is that for each spectral band one must sacrifice the number of 
pixels. In practice, for a 256 x 256 image one cannot go beyond 4 bands. An 
analysis shows that the complexity of deconvolving the spectrum of retinal tissue 
10 is such that 4 bands will simply not be sufficient. Aknost all the algorithms 
presented herein and exploited by the present invention rely on continous spectral 
data (of at least 20 - 100 data point resolution) to compensate for various 
biological diversity from point to point or patient to patient. A theoretical analysis 
of hemoglobin spectra shows that there is no benefit in improving spectral 
15 resolution to better than 9 nm for hemoglobin (Hb) oxygen saturation (OS) 
measurements. Another system is one bemg developed by Zeiss, which can only 
provide the data on a short line and cannot be extended to an image 

See also (i) FC Delori, "Noninvasive technique for oximetry of blood in 
retinal vessels", Applied Optics 27:1113-1125, 1988; (ii) FC Delori and KP 
20 Pflibsen, "Spectral reflectance of the ocular fundus", Applied Optics 28:1061- 
1077, 1989; (iii) J Sebag, FC Delori, GT Feke, JJ Weiter, "Effects of Optic 
Atrophy on Retinal Blood Flow and Oxygen Saturation in Humans", Arch. 
Ophthalmol. 107:222-226, 1989; (iv) HA Braining, GJM Pierik, C Ince, and F 
Ashmf, "Optical spectroscopic imaging for non-invasive evaluation of tissue 
25 oxygenation", Chirurgie 118:317-323, 1992; (v) M Hanuner, D Schweitzer, L 
Leistritz, M Scibor, K-H Donnerhacke, and J Strobel, "Imaging Spectroscopy in 
Human Ocular Fundus In Vivo", J. Biomed. Optics 2:418-425, 1997; (vi) MH 
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Smith, KR Denninghoff, LW Hillman, and RA Chipman, "Oxygen saturation 
measurements of blood in retinal vessels during blood loss", J Biomedical Optics 
3:296-303, 1998; (vii) JS Tiedeman, SE Kirk, S Srinivas, JM Beach, "Retinal 
Oxygen Consumption during Hyperglycemia in Patients witii Diabetes witiiout 
Retinopatiiy", Ophthahnology, 105(l):31-36, 1998; and (vui) D Schweitzer, L 
Leistritz, M Hammmer, M Scibor, U Bartsch and J Strobe!, "Calibration-free 
measurements of tiie oxygen saturation in retinal vessels of men" SPIE 2393:210- 
218, 1995. In general, the prior art fails to measure or acquire spectral unages, and 
is therefore limited to eitfier selected small regions on the analyzed tissue or a 
small number of wavelengths. 

The following summarizes tfie main differences between die prior art and 
what is covered by this embodiment of the present invention: 

(i) Prior art instruments do not produce a spectiial cube, so tfiey cannot 
be applied to an hnage. Therefore, die points being measured should be chosen 
apriori. Thus, tfie prior art do not provide a tool for examining the retina as a 
whole. 

(ii) In sharp contrast to the prior art and as further detailed hereundw, 
the present invention employs a special "local background compensation metiiod" 
which takes into account die variability of die background tissue and die signal's 
quality. By applying smart averaging on regions witii similar background tissue 
while taking into account die spectral variability of flie tissue, die noise level is 
reduced and a robust measurement of die oxygen saturation in die blood vessel is 
obtamed. It turns out diat this reduces noise and increases die robustness of the 
results widi respect to biological variability. In die prior art a background 
compensation mediod has been used to measure two spots next to each odier, one 
on die vessel and one close to it. As an example of die superiority of die mediod 
of die present invention it should be noted that in die prior art mediod die 
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background point is chosen by the eye of the user which may mistakenly and 
wrongfiilly select a background point which contains a choroidal vessel, while tiie 
analyzed point does not include one, thereby distorting the result. 

(iii) In the prior art, results are shown only based on a few wavelengths 

5 (typically 2, 3 or 4). Ocassionally, the prior art is somewhat superior in spectral 
resolution, but, as further explained below, cannot be used to carry out a 
differential fit and is therefore much more disturbed by scattering. Moreover, in 
general, by basing the calculations on a larger number of wavelengths, as done in 
the presented invention, the number of equations upon which the oxygen saturation 

10 data are fitted to the model is increased, thus increasing the reliability of the results 
obtained. 

A simple model that describes the reflection I^Wof white light from the 
retina is obtained by assuming that the illumination signal is transmitted through N 
partially absorbing and partially scattering layers and reflected back from a white 
15 substrate (the sclera) through the same layers. The attenuation of the signal by 
each layer is described by the Beer-Lambert law, and the measured signal is thus 
given by: 

/^(A) = »^(A).expH|;a,(A).2/,)], 



20 where W(A) is the intensity of the incident light; is the index of the 

layers; a, (A), which is a function of the wavelength X, is the corresponding 
attenuation coefficient; is the thickness of the layer /, where it is assumed that 
the light is reflected back and forth through the same layers to give the factor 2. 
Removing the layer (the vessel) gives rise to: 

25 ' (33) 

Dividing Equation 32 by Equation 33 yields: 

/^/V,=exp[-a;, -2/J (34). 
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/^//^.,=exp[-a^(A)./J (35) 

Within the framework of the Beer - Lambert law, one assumes two 
contributions to aj^{X)^ the first due to absorption, MnW^ and the second due to 
scattering, s^iX). When the iV* layer is a blood vessel, its attenuation 
characteristics are dominated by the absorption coeficient of hemoglobin, which 
varies strongly with JL in the region between 500 nm and 650 nm, while the 
scattering coefficient, Sf^(A) , is weakly dependent on the wavelength A . 

Thus, in the wavelength region of 500 nm - 650 nm one assxmies that the 
following holds approximately: 

da^(X)/dX^d/i^(A)/dZ (36) 

For /i(A)in the case of hemoglobin (see, for example, FC Delori, 
"Noninvasive technique for oximetry of blood in retinal vessels". Applied Optics 

27:1 1 13-1 125, 1988), one applies the effective medium approximation: 
/<^)=^//*p,(^).pft02]+^;,,(A).[/»] ^3^^ 

where [//iOj] and [Hb] are the concentration of the o?(ygenated and deoxygenated 
hemoglobin, respectively, and %b02(X) and ^miX) are the oxygenated and 
deoxygenated hemoglobin absorption coefficients, respectively. The oxygen 
saturation, OS, is measured in percent and is defined as: 

OS ^ 100 x[ Hbq ] /(t Hbq ] +[ Hb] )(38). 
Combining Equations 34, 36, and 37 one obtains: 

■ -^2^""^^^ ^^^^^ =2/^ "^^T^ [HbO,]^^ [Hb]] 
d A- d X d X (39) 

The fact that typically the hemoglobin concentration, c, in human blood is 
constant is exploited, i.e.: 

c = [Hb02\ + [Hb] = const = 8.98 ^mole/ml (40) 

and therefore: 



\ dX dX ) 



+ 100 



de„M) 
dX 



(41) 
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Equation 41 is the basic expression of tiie oxygen saturation model 
according to the present invention for an object in the ocular fundus or in any other 
suniiar layered structure. The left hand side of Equation 41 contains only 
measured quantities (Ijsf, Ij^f.j), while the right hand side contains the known 
5 quantities SHbOjCX) and SHb(X), and the unknown quantities Iff and OS. 

It will be appreciated that melanin and other pigments present in living 
tissue, and important in the characterization of the tissue in question, may also be 
measured in a similar way. 

It should be noted that when the oxygenation state of a general tissue is 
10 measured, whether in the ocular fundus or in other regions of the body, one can use 
Equation 41 with the following changes: 

is now the signal from the tissue (between vessels), and as reference 
signal. If/, J, one now employes the reflected light from a white target positioned in 
place of the tissue to be measured. An ideal white target is defined as a target 
15 which reflects 100 % of the light incident on it at all wavelengths. The ideal white 
target is a physical abstraction, but practical plates which approach the ideal white 
target are available commercially from several companies, such as Labsphere Inc. 
and others. 

Equation 41 is the basis for calculating the oxygen saturation in a specific 
20 object such as a retinal or choroidal blood vessel, using spectral data derived, for 
example, from a spectral cube of data. 

For purpose of illustration only, the following descriptions focus mainly on 
retinal vessels, unless otherwise specified. 

Thus, Iff is defined as the reflected spectral intensity from a retinal vessel, 
25 and If/^j is a reference spectral intensity representing the reflection from all the 
other layers. In order to measure I^{X) and I^^^^W a special algorithm and user 

interface have been developed for the SPECTRACUBE^ instrument to enable the 
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definition of a region of interest, e.g., a blood vessel (see, for example, region 1 in 
Figures 30a-b) and its surroundings on the ocular fundus (region 3 in Figures 30a- 
b). 

Two assumptions are now made: (i) the oxygen saturation level in the 

5 vessel is not a strong function of the location within the region of interest, which 
allows one to improve the signal to noise ratio of the measured Ijq by averaging it 
over many pixels along the vessel; and (ii) the close surroundings of the region of 
interest on the vessel represents the layers underneath the region of interest on the 
vessel when its spectrum V,(A) is avenged over several pixels in the same region 

10 as further explained below. 

The values of I^{X)ds\d /^..(A) so obtained are substituted in the left-hand 
side of Equation 41, vmte^{X) and e^{X) from the literature are substimted in 
the right hand side of Equation 41. In order to compensate for the spectral 
resolution of the measuring system, which is lower than the spectral resolution 

15 upon which e^{X) and e^{X) were obtained in the literature, die functions 
^/fto,('^) and f^iCA) are preferably convolved with a broadening window. l„ and 
OS are then calculated by best fitting the two sides of Equation 41 using a minimal 
squares technique under the restriction that c, which is the typical hemoglobin 
concentration in human blood (see above), is a constant. Upon fitting, one allows 

20 a spectral shift of a few nanometers in order to account for residual scattering 
effects. The difference between the measured and the calculated values in 
Equation 41, which is indicative of the quality of the fit, is then used in order 
evaluate the applicability of the model in every specific case. The value of c that 
is used is preferably 8.98 funole/ml. This is a standard value for the total 

25 hemoglobm concentration in humans. It does vary fix)m pason to person and 
according to Equation 41 it also influences the estimated value for the thickness 
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Iff. See, van Assendelfi OW, Spectrophotometry haemoglobin derivatives, Charles 
C Thomas, Springfield IL, 1970. 

In order to reduce errors that may result from local variability of the tissue 
surrounding the region of interest on the vessel, a method of local background 

5 averaging has been developed (Figure 31). The region of interest on the vessel 
together with its surrounding backgroimd region are sliced along their curved 
equator (the curvature arising from the shape of the vessel); accordingly, the vessel 
is sliced across its length, as indicated by the black, pink, green and red colors of 
the central image of Figure 31. The size of the slices is determined by the desired 

10 signal to noise ratio. The slices should be large enough to reduce noise, but not too 
large in order not to introduce distortions of the local background spectrum. 
Equation 41 is then applied to each slice separately, and the final result for the 
specific vessel is obtained by a weighted average of the results from all the slices 
(Figure 32). 

15 The weight of each slice is defined in this example by the product of the 

signal to noise ratio of the slice, the mmiber of pixels used and the fit quality of the 
slice. Clearly, different definitions may be used. 

The result of the weighted average of the oxygen saturation along various 
retinal vessels in the image is displayed as a % saturation value shown on each 

20 corresponding vessel (see Figures 4a-and 5a-c). 

Although the invention has been described in conjunction with specific 
embodiments thereof, it is evident that many alternatives, modifications and 
variations will be apparent to those skilled in the art. Accordingly, it is intended to 
25 embrace all such alternatives, modifications and variations that fall within the 
spirit and broad scope of the appended claims. 
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WHAT IS CLAIMED IS: 

1. A spectral bio-imaging method for enhancing spectral signatures of 
an eye tissue, the method comprising the steps of: 

(a) providing an optical device for eye inspection being optically 
connected to a spectral imager; 

(b) illuminating the eye tissue with light via the iris, viewing the eye 
tissue through said optical device and spectral imager and obtaining a 
spectrum of light for each pixel of the eye tissue; and 

(c) attributmg each of said pixels a color or intensity according to its 
spectral signature, thereby providing an image enhancing the spectral 
signatures of the eye tissue. 

2. The method of claim 1, wherem said spectral unager is selected from 
the group consistmg of a filters based spectral imager, a monochromator based 
spectral imager and an interferometer based spectral imager. 

3. The method of claim 2, wherein step (b) includes 

(i) collecting incident light simultaneously from all pixels of said eye 
using collimating optics; 

(ii) passing said mcident coUimated light through an interferometer 
system having a number of elements, so that said light is first split 
into two coherent beams which travel in different directions inside 
said interferometer and then said two coherent beams recombine to 
interfere with each other to fomi an exiting light beam; 
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(iii) passing said exiting light beam through a focusing optical system 
which focuses said exiting light beam on a detector having a two- 
dimensional array of detector elements; 

(iv) rotating or translating one or more of said elements of said 
interferometer system, so that an optical path difTerence between said 
two coherent beams generated by said interferometer system is 
scanned simultaneously for all said pixels; and 

(v) recording signals of each of said detector elements as function of 
time using a recording device to form a spectral cube of data. 

4. The method of claim 1, wherein said optical device is selected &om 
the group consisting of a fundus camera and a funduscope. 

5. The method of claim 1, wherein said spectrum of light represents 
light selected from the group consisting of, light reflected from the eye tissue, light 
scattered from the eye tissue and light emitted from the eye tissue. 

6. The method of claim 5, wherein said light emitted from said eye 
tissue is selected from the group consisting of administered probe fluorescence, 
administered probe induced fluorescence and auto-fluorescence. 

7. The method of claim 1, wherein said light used for illuminating the 
eye tissue is selected from the group consisting of coherent light, white light, 
filtered light, ultraviolet light, infrared light and a light having a small wavelength 
range. 
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8. The method of claim 3, wherein said two-dimensional array is 
selected from the group consisting of a video rate CCD, a cooled high dynamic 
range CCD, an intensified CCD and a time gated intensified CCD. 

9. The method of claim 1, wherem said eye tissue is selected from the 
group consisting of eye retina, a retinal blood vessel an optic disk, an optic cup, 
eye macula, fovea, cornea, iris, lens, nerve fiber layer, choroid, choroidal layer, 
choroidal blood vessel, pigment epithelium and Bruch's membrane, 

10. The method of claim 1, wherein the eye tissue includes a blood 
vessel the method is for detecting and mapping the oxygenation level of 
hemoglobin along the blood vessel. 

11. The method of claim 1, wherein step (c) is effected using a 
mathematical algorithm which computes a Red-Green-Blue color image using 
predefined wavelength ranges. 

12. The method of claim 1, wherein said spectral signature and, as a 
result, said color is affected by a substance selected from the group consisting of 
hemoglobin, cytochromes, oxidases, reductases, flavins, nicotinamide adenine 
dinucleotide, nicotinamide adenine dinucleotide phosphate, collagen, elastm, 
xanthophyll and melanin. 

13. The method of claim 1, wherein enhancing the spectral signatures of 
the eye tissue includes an enhancement selected from the group consistmg of 
enhancing arteries, enhancing vems, enhancing hemoglobin concentration. 
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enhancing hemoglobin oxygen saturation level, enhancing melanoma lesions and 
enhancing hemangioma lesions. 

14. The method of claim 3, further comprising the step of correcting 
spatial and spectral information for movements of the eye tissue via a spatial 
registration and spectral correction procedures. 

15. A method of evaluating a medical condition of a patient comprising 
the step of enhancing spectral signatures of an eye tissue of the patient by: 

(a) providing an optical device for eye inspection being optically 
connected to a spectral unager, 

(b) illuminating the eye tissue of the patient with light via the iris, 
viewing the eye tissue through said optical device and spectral 
imager and obtaining a light spectrum for each pixel of the eye 
tissue; 

(c) attributing each of said pixels a color or intensity according to its 
spectral signature, thereby providing an image enhancing the spectral 
signatures of the eye tissue; and 

(d) using said image to evaluate the medical condition of the patient. 

16. The method of claim 15, wherein said medical condition is selected 
from the group consisting of diabetic retinopathy, ischemia of the eye, glaucoma, 
macular degeneration, CMV eye infection, melanoma lesions, hemangioma 
lesions, retinitis, choroidal ischemia, acute sectorial choroidal ischemia, ischemic 
optic neuropathy, and corneal and iris problems. 
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17. An apparatus for providing a display of an image presenting an eye 
tissue, wherein each pixel in said image is assigned a color or intensity according 
to a spectral signature of a tissue element from which it is derived, thereby 
enhancing the spectral signature of the eye tissue comprising: 

(a) an optical device for eye inspection being optically connected to a 
spectral imager; 

(b) an illumination source for illuminating the eye tissue with light via 
the iris; and 

(c) an image display device for displaying the image; 

wherein the image is realized by viewing the eye tissue through said optical device 
and spectral imager and obtaining a spectrum of light for each pixel of the eye 
tissue; and fiirther by attributing each of said pixels a color or intensity according 
to its spectral signature, thereby providing the unage enhancing the spectral 
signatures of the eye tissue. 

18. A spectral bio-imaging method for obtaining a spectrum of a region 
of an eye tissue, the method comprising the steps of: 

(a) providing an optical device for eye inspection being optically 
connected to a spectral imager; 

(b) illuminating the eye tissue with light via the iris, viewing the eye 
tissue through said optical device and spectral imager and obtainmg a 
spectrum of light for each pixel of the eye tissue; and 

(c) displaying a spectrum associated with said region. 
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19. A spectral bio-imaging method for enhancing spectral signatures of 
an eye tissue, the method comprising the steps of: 

(a) providing an optical device for eye inspection being optically 
connected to a high throughput spectral imager; 

(b) illuminating the eye tissue with light via the iris, viewing the eye 
tissue through said optical device and spectral imager and obtaining a 
spectrum of light for each pixel of the eye tissue; and 

(c) attributing each of said pixels a color or intensity according to its 
spectral signature in a predefined spectral range, thereby providing 
an image enhancing the spectral signatures of the eye tissue. 

20. The method of claim 19, wherein said spectral imager is selected 
from the group consisting of a wideband filters based spectral imager, 
decorrelation matched filters based spectral imager, a successively monochromatic 
illumination based spectral imager and an interferometer based spectral imager. 

2 1 . The method of claim 20, wherein step (b) includes: 

(i) collecting incident light simultaneously from all pixels of said eye 
using coUimating optics; 

(ii) passing said incident coUimated light through an interferometer 
system having a number of elements, so that said light is first split 
into two coherent beams which travel in different directions inside 
said interferometer and then said two coherent beams recombine to 
interfere with each other to form an exiting light beam; 

(iii) passing said exiting light beam through a focusing optical system 
which focuses said exiting light beam on a detector having a two- 
dimensional array of detector elements; 
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(iv) rotating or translating one or more of said elements of said 
interferometer system, so that an optical path difference between said 
two coherent beams generated by said interferometer system is 
scanned simultaneously for all said pixels; and 

(v) recording signals of each of said detector elements as function of 
. time using a recording device to form a spectral cube of data. 

22. The method of claim 19, wherein said optical device is selected from 
the group consisting of a fundus camera and a fimduscope. 

23. The method of claim 19, wherein said spectrum of light represents 
light selected from the group consisting of, light reflected from the eye tissue, light 
scattered from the eye tissue and light emitted from the eye tissue. 

24. The method of claim 23, wherein said light emitted from said eye 
tissue is selected from the group consisting of administered probe fluorescence, 
administered probe induced fluorescence and auto-fluorescence. 

25. The method of claim 19, wherein said light used for illuminating the 
eye tissue is selected from the group consisting of coherent light, white light, 
filtered light, ultraviolet light and a light having a small wavelength range. 

26. The method of claim 21, wherein said two-dimensional array is 
selected from the group consisting of a video rate CCD, a cooled high dynamic 
range CCD, an intensified CCD and a time gated intensified CCD. 
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27. The method of claun 19, wherein said eye tissue is selected from the 
group consisting of eye retina, a retmal blood vessel an optic disk, an optic cup, 
eye macula, fovea, cornea, iris, lens, nerve fiber layer, choroid, choroidal layer, 
choroidal blood vessel, pigment epitheliimi and Bruch- s membrane. 

28. The method of claim 19, wherein the eye tissue includes a blood 
vessel the method is for detecting and mapping the oxygenation level of 
hemoglobin along the blood vessel. 

29. The method of claim 19, wherein step (c) is effected using a 
mathematical algorithm which computes a Red-Green-Blue color image using 
predefined wavelength ranges. 

30. The method of claim 19, wherein step (c) is effected using a 
mathematical algorithm which computes a gray scale image using predefmed 
wavelength ranges. 

31. The method of claim 19, wherein said spectral signature and, as a 
result, said color is affected by a substance selected from the group consisting of 
hemoglobin, cytochromes, oxidases, reductases, flavins, nicotinamide adenine 
dinucleotide, nicotinamide adenine dinucleotide phosphate, collagen, elastin, 
xanthophyll and melanin. 

32. The method of claim 19, wherein enhancing the spectral signatures 
of the eye tissue includes an enhancement selected from the group consisting of 
enhancing arteries, enhancing veins, enhancing hemoglobin concentration. 
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enhancing hemoglobin oxygen saturation level, enhancmg melanoma lesions and 
enhancing hemangioma lesions. 

33. The method of claim 21, further comprising the step of correcting 
spatial and spectral information for movements of the eye tissue via a spatial 
registration and spectral correction procedures. 

34. A method of evaluating a medical condition of a patient comprising 
the step of enhancing spectral signatures of an eye tissue of the patient by: 

(a) providing an optical device for eye inspection being optically 
connected to a high throughput spectral imager; 

(b) illummating the eye tissue of the patient with light via the iris, 
viewing the eye tissue through said optical device and spectral 
imager and obtaining a light spectrum for each pfacel of the eye 
tissue; 

(c) attributing each of said pixels a color or intensity according to its 
spectral signature in a predefined spectral range, thereby providing 
an image enhancing the spectral signatures of the eye tissue; and 

(d) usmg said image to evaluate the medical condition of the patient. 

35. The method of claim 34, wherein said medical condition is selected 
from the group consisting of diabetic retinopathy, ischemia of the eye, glaucoma, 
macular degeneration, CMV eye infection, retinitis, choroidal ischemia, acute 
sectorial choroidal ischemia, ischemic optic neuropathy, and corneal and iris 
problems. 
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36. An apparatus for providing a display of an image presenting an eye 
tissue, wherein each pixel in said image is assigned a color or intensity according 
to a spectral signature of a tissue element from which it is derived, thereby 
enhancing the spectral signature of the eye tissue comprising: 

(a) an optical device for eye inspection being optically connected to a 
spectral imager; 

(b) an illumination source for illuminating the eye tissue with light via 
the iris; and 

(c) an image display device for displaying the image; 

wherein the image is realized by viewing the eye tissue through said optical device 
and spectral imager and obtaining a spectrum of light for each pixel of the eye 
tissue and further by attributing each of said pixels a color or intensity according to 
its spectral signature in a predefined spectral range, thereby providing the image 
enhancing the spectral signatures of the eye tissue. 

37. A spectral bio-imaging method for enhancing spectral signatures of 
at least two eye tissues, each of a different spectral signature, the method 
comprising the steps of: 

(a) providing an optical device for eye inspection being optically 
connected to a spectral imager; 

(b) illuminating the eye tissues with light via the iris, viewing the eye 
tissues through said optical device and spectral imager and obtaining 
a spectrum of light for each pixel of the eye tissues; 

(c) selecting spectral ranges highlighting the different spectral signatures 
of each of the at least two eye tissues; and 

(d) generating an image enhancing the different spectral signatures of the 
at least two eye tissues. 
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38. A spectral bio-imaging method for enhancing blood vessels of an eye 
tissue, the method comprising the steps of: 

(a) providing an optical device for eye inspection being optically 
connected to a spectral imager, 

(b) illuminating the eye tissues with light via the iris, viewing the eye 
tissue through said optical device and spectral imager and obtaining a 
spectrum of light for each pixel of the eye tissue; 

(c) employing an algorithm highlighting a spectral signature of blood 
vessels; and 

(d) generating an image enhancing the blood vessels. 

39. An apparatus for providing a display of an image presenting an eye 
tissue in which blood vessels are enhanced by a color or intensity according to a 
spectral signature specific thereto, the apparatus comprising: 

(a) an optical device for eye inspection being optically connected to a 
spectral imager; 

(b) an illumination source for illuminating the eye tissue with light via 
the iris; and 

(c) an image display device for displaying the image; 

wherein the image is realized by viewing the eye tissue through said optical device 
and spectral imager and obtaining a spectrum of light for each pixel of the eye 
tissue; and further by attributing each of said pixels a color or intensity according 
to its spectral signature, thereby enhancing the spectral signature of blood vessels 
in the eye tissue. 
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40. A spectral bio-imaging method for extracting a spectral signature of 
a first portion of a layer of an object including at least two layers, each of said at 
least two layers has different spectral characteristics, the method comprising the 
steps of: 

(a) providing an optical device being optically connected to a spectral 
imager; 

(b) illuminating the object with light, viewing the object through said 
optical device and spectral imager and obtaining a continuous 
spectrum of light for each pixel of the object; 

(c) using said continuous spectrum of light of each pixel of the object for 
generating a spectral image of the object in which the first portion is 
identifiable; 

(c) identifying in said spectral image the first portion of the layer and a 
second portion being adjacent said first portion; and 

(d) accounting for spectral characteristics of said second layer, extracting 
the spectral signature of the first portion. 

41. The method of claim 40, wherein said object is an ocular fundus, 
said at least two layers include a retinal layer and a choroidal layer and said first 
portion is selected from the group consisting of a retinal blood vessel and a 
choroidal blood vessel. 

42. The method of claim 40, wherein said spectral signature is indicative 
of an oxygenation state of said first portion. 

43. The method of claim 41, wherein said spectral signature is indicative 
of an oxygenation state of said first portion. 
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44. The method of claim 43, further comprising the step of marking a 
mark indicative of said oxygenation state of said first portion on said spectral 
image in context of said first portion. 

45. The method of claim 44, wherein said mark is a numerical value. 

46. The method of claim 40, wherein said step of extracting the spectral 
signature of the first portion includes averaging over a plurality of said pixels. 

47. The method of claim 1 , wherein said spectral imager is selected from 
the group consisting of a filters based spectral imager, a monochromator based 
spectral imager and an interferometer based spectral imager. 

48. The method of claim 47, wherein step (b) includes: 

(i) collecting incident light simultaneously from all pixels of said object 
using collimating optics; 

(ii) passing said incident coUimated light through an interferometer 
system having a number of elements, so that said light is Gist split 
into two coherent beams which travel in different directions inside 
said interferometer and then said two coherent beams recombine to 
interfere with each other to form an exiting light beam; 

(iii) passing said exiting light beam through a focusing optical system 
which focuses said exiting light beam on a detector having a two- 
dimensional array of detector elements; 

(iv) rotating or translating one or more of said elements of said 
interferometer system, so that an optical path difference between said 
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two coherent beams generated by said interferometer system is 
scanned simultaneously for all said pixels; and 
(v) recording signals of each of said detector elements as function of 
time using a recording device to form a spectral cube of data. 

49. The method of claim 40, wherein said optical device is selected from 
the group consisting of a fundus camera and a funduscope. 

50. The method of claim 40, wherein said continuous spectrum of light 
represents light selected from the group consisting of, light reflected from the 
object and light scattered from the object. 

51. The method of claim 40, wherein said light used for illuminating the 
object is selected from the group consisting of coherent light, white light, filtered 
light, ultraviolet light and a light having a small wavelength range. 

52. The method of claim 48, wherein said two-dimensional array is 
selected from the group consisting of a video rate CCD, a cooled high dynamic 
range CCD, an intensified CCD and a time gated intensified CCD. 

53. The method of claim 48, further comprising the step of correcting 
spatial and spectral information for movements of the eye tissue via a spatial 
registration and spectral correction procedures. 
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54. A method of evaluating a medical condition of a patient comprising 
the step of extracting a spectral signature of a retinal or choroidal blood vessel of a 
retina or choroid of an eye by: 

(a) providing an optical device being optically connected to a spectral 
imager; 

(b) illuminating the eye with light, viewing the eye through said optical 
device and spectral imager and obtaining a contmuous spectrum of 
light for each pixel of the eye; 

(c) using said continuous spectrum of light of each pixel of the eye for 
generating a spectral image of the eye in which the retinal or 
choroidal blood vessel is identifiable; 

(c) identifymg in said spectral image the retinal or choroidal blood 
vessel and a tissue being adjacent to the retinal or choroidal blood 
vessel; 

(d) accounting for spectral characteristics of said tissue, extracting the 
spectral signature of the retinal or choroidal blood vessel; and 

(e) using said spectral signature to evaluate the medical condition of the 
patient. 

55. The method of claim 54, wherein said medical condition is selected 
from the group consisting of diabetic retinopathy, ischemia of the eye, glaucoma, 
macular degeneration, CMV eye infection, melanoma lesions, hemangioma 
lesions, retinitis, choroidal ischemia, acute sectorial choroidal ischemia, ischemic 
optic neuropathy, and corneal and iris problems. 
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S6. An apparatus for providing a display of an image presenting an eye 
tissue and a maridng of an oxygenation state of at least one blood vessel therein, 
the apparatus comprising: 

(a) an optical device for eye inspection being optically connected to a 
spectral imager; 

(b) an illumination source for illuminating the eye tissue with light via 
the iris; and 

(c) an image display device for displaying the image; 

wherein the image is realized by viewing the eye tissue through said 
optical device and spectral imager and obtaining a spectrum of light 
for each pixel of the eye tissue; by attributing each of said pixels a 
color or intmsity according to its spectral signature, thereby 
providing the image enhancing the spectral signatures of the eye 
tissue; and further by maridng in context of the at least one blood 
vessel the oxygenation state thereof 



wo 00/67635 



PCT/IL00y00255 



1/29 




1 or 2.d 
Scanner 

I 



7 



Interferometer 
or Optical Path 
Difference 
Generator ^ 





1 or 2.d 




Detector 




Array 



22 



24 26 



Fig. 1 (Prior Art) 



Signal 
Processing 
and Display 



28 




Fig. 2(Prior Art) 




SUBSTITUTE SHEET (RULE 26) 



WO00/67d35 



2/29 



PCT/IL0IMH)255 




SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



3/29 



PCT/ILOO/00255 




SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



4/29 



PCT/ILOO/D0255 




FIG. 4b 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



PCT/ILOO/00255 




SUBSTITUTE SHEET (RULE 26) 



WO00/6763S 



PCT/IL00/002S5 




SUBSTITUTE SHEET (RULE 26) 




SUBSTITUTE SHEET (RULE 26) 



WO0(M»7635 



PCTm.00/00255 



8/29 




SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



PCT/ILOO/00255 




4000 



350 



300 i 
>. 

^250 
c 
a> 

c200 i 
= 150i 
OilOOH 



50- 



Fig. 7a 



— I 

100 150 
Pixel No. 

Fig. 7b 



200 



4000 




intensity (pixel) 

Fig. 7c 



Intensity (pixel) 

Fig. 7d 




1^ 

50 



I 

100 



— I 

150 200 



Pixel No. 

Fig. 7e 




SUBSTITUTE SHEET (RULE 26) 



wo 00/67d35 



PCT/ILOO/00255 




SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



11/29 



PCT/ILOO/00255 




SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



PCT/IL00/002S5 



Hbo 



Hb 



16- 
12 

•*-» 
C 
0) 

o 

e 8- 
8 

I 4- 

o 
c 

LU 0' 





i 






1 










\ 


i 


i 



































12/29 
0.1 - 



Vein 



^ 0- 
1-0.1- 
?.0.2 ■ 



o 
in 



CM 
lO 



CO 

o o 



CO 

in 



o 

CD 



CM 
CO 



CO 



-0.3 









— ^ 










After 


y 






/ 

If 








\\ 
\\ 

\\ 












— 





o o o o 
Wavelength (nm) 



o 
o 
in 



o 

CM 

in 



o o 

CD 

in in 



o o 
GO o 
in CD 



o 

CM 
CD 



Fig. 9 



Wavelength (nm) 

Fig. 10 



-31 
^ -33 

S -37 



-39 
-41 



Vessel 



Retina 



Disc 



Cup 



o 
o 
in 



o 

CM 

in 



o 
in 



o 

CD 

in 



o 

GO 

in 



o 
o 

CO 



Fig. 1 1 



Wavelength (nm) 

Green (540nm) 
Red(640nm) \ \ Blue(490nm) 



Nerve fiber layer 



Rodes & cones 
RPE 

Choroid 




Fig. 12 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



PCT/ILOO/00255 



13/29 



8 

7 

6 

5' 

4- 

3- 

2 

1 • 

0- 



1 1 1 








"M Retina 
'o Perifov( 
Fovea 






M 


















1 




















— o- 
■ 










m 


Mo 










° 5 


) oo 
i ■■ 


■ 






■ 















oooooooo 

OCM-^ODCOOCM^ 
tOmiOIOLOCOCDCD 

Wavelength (nm) 

Fig. 13a 



8- 
7- 
3 6- 
< 5- 

1 
o 3- 

© 2 
q: 

1 



M Retina 
o Perifove 
■ Fovea 












M 








» 




0 












o 
o 














o 
















h 


jano 























oooooooo 
loioiotnmcocoto 
Wavelength (nm) 

Fig. 13b 




oooooooo 

OCMrfCDOOOCMrr 
tOLOLOLOtOCOCOCO 

Wavelength (nm) 

Fig. 13c 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



14/29 



PCT/ILOO/00255 



HG. 14a HG. 14b HG. 14c 




RGB Image Spectrafiy enhanced RGB 610 nm 



HG. 14<l HG. 14e 




564 nm Hemoglobin oxygenafion 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



PCT/ILOO/002SS 



15/29 

d) 
L 



o 



II 
■ 

II 

■ 
■ 


□ 

□ 
□ 


3 

□ 












CO 

o 


... — , 


1 

■ 

■ 

1 


u 

I 

■ 

■ 


] 

□ 

n 


□ 

□ 








CM 
CO 

O 








■ 

■ 


□ 

1 


o 

D 
□ 

a 
□ 






O 
CD 

O 












□ 
□ 

□ 
□ 

□ 
□ 






00 

to 
o 






O) 






□ 
□ 
□ 

D 
□ 
D 

_ _ n 






CO 

in 
o 






■ hemorrha 
□ retina 






□ 
□ 
□ 

□ 

□ 

□ — 






in 

o 










1 

■ — 


□ 
□ 

□ 

□ 
□ 

□ 

— □ 






CM 
LO 

o 


















o 



O) 

c 
o 

(D 
> 
CD 



00h.<Dl0rtC0CNT-O 

( n v) ><}!A!Joe|i8y 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



PCT/ILOO/0O255 



16/29 




Fig. 16 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



17/29 



PCT/ILOO/002S5 



HG. 17 




HG. 18a HG. 18b 




564 nm Hemogicbin concerirarion 

SUBSTITUTE SHEET (RULE 26) 



WO0Q/6763S 



18/29 



PCT/ILOO/00255 



FIG. 19a FIG. 19b HG." 19c 




RGB image 



610 nm 



564 nm 



HG. 19d 





Hemoglobin concentration 



Image Icey 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



19/29 



PCT/ILOO/00255 




no. 20 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



PCT/IL00/0Q255 



20/29 



4500 
4000 
3500 
3000 
2500 



M 

«2000 



1500 
1000 
500 



□ 
□ 



D 
□ 
□ 



O 

b 

D 



o 
X 
+ 



Choroidal vessel 
Retinal vein 
Retinal artery 
Region between vessels 

White target 



□ 
□ 



a o "o 




+ X 




I 



□□□□□ □□□□c 



500 



550 600 
Wavelength 



650 



700 



Fig. 21 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



PCT/ILOO/00255 



21/29 



CO 

c 

CQ 



CO 

c 



0.5 



0 - 



eg 
u 

O 



-0.5 



y XX XXXXX Xv 
f X ^ ^x 



^Xx 



o 
X 



P. 



x 

x 

+ X 

+ 



o^x 

X 

o*-x 

o*X 



Choroidal vessel 

Retinalvein 

Retinal artery 

Region between vessels 



o 

o 



500 



550 



600 



650 



Wavelength 

Fig. 22 



SUBSTITUTE SHEET (RULE 26) 



WO00/67fi35 



22/29 



vcrnuomiass 




HG. 23 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



23/29 



PCT/ILOO/00255 




HG. 24 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



24/29 



PCT/IL00/D0255 




HG. 25 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



PCT/ILOO/00255 




SUBSTITUTE SHEET (RULE 26) 



WO00/67«35 



26/29 



PCT/ILOO/00255 




SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



27/29 



PCT/ILOO/00255 




SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



PCT/lLOO/00255 



28/29 



Oxygen Saturation 




I I u -J 1 1 -* 

1 1^ 2 2.5 3 33 4 

Slice Number 

PIG. 32 




FIG. 33A . HG. 33B 



SUBSTITUTE SHEET (RULE 26) 



wo 00/67635 



29/29 



PCT/ILOO/00255 




SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 


International application No. 




PCT/ILOO/00255 


A. CLASSIFICATION OF SUBJECT MATTER 




IPC{7) :A6IB 3/!4 




US CL :35/206 




According to International Patent Classification UPC) or lo both national classification and IPC 


B. FIELDS SEARCHED 



Minitnum documentation searched (classiftcation system followed by classification symbols) 



U.S. : 35/206 



Documentation searched other than minlmimi documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Categofv* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5.539,517 A (CABIB ET AL.) 23 JULY 1996, ENTIRE 
DOCUMENT. 

US 5.784.162 A (CABIB ET AL.) 21 JULY 1998, ENTIRE 
DOCUMENT. 



1-56 
1-56 



I I Further documents are listed in the continuation of Box C. | | See patent family annex. 



Special caiegoiies of cited documents: 

A" document defining the general state of the art which is not considered 

to be of panicular reievaiKe 

E" earlier document published on or after the tntemationat fih'ng date 

1* document which may throw doubts on pnoriiy ciatm(s) or which is 

cited to estabhsh the publication date of another citation or other 
special reason (as specified) 

"0" d jcument referring to an oral disclosure, use. exhibition or other means 

"P" document published prior to the international filing date but later than 

the priority date claimed 



T" later document published after the intcmaiionai filing date or priority 

date and not in conflict with the application but cited to understand the 
principle or theory underlying the invention 

"X" document of particular relevance; the claimed invention cannot be 

considered novel or cannot be consiiiered to involve an invemive step 
when the document is uken alone 

"Y" document of particular relevance; the claimed invention cannot be 

considered to involve an inventive step when the document is 
combtt>ed witl« one or more other such documents, such combination 
being obvious to a perM>n skilled in the art 

document member of the same patent family 



Date of the actual completion of the international search 
20 AUGUST 2000 


Date of mailing of the international search repon 

30 AUG 2000 _ 


Name and mailing address of the ISA/US 
Commissioner of Patents and Trademarks ^ 
Box PCT 

Washington. D.C. 2023 1 / 
Facsimile No. (703) 305-3230 / 


^ GEORGC^ MANUEL ^ ^ 

Telephone No. (703) 308-21 18 



Form PCT/ISA/210 (second sheet) (July 1998)* 



